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(54) Data transfer and synchronization system 

(57) A system and method for synchronizing devic- 
es which can couple to the Internet, or any network. In 
one aspect a system for synchronizing data between a 
first system and a second system is provided. The sys- 
tem includes a first sync engine on the first system in- 
terfacing with data in the first system to provide differ- 
ence information. A data store is coupled to network and 
in communication with the first and second systems. A 
second sync engine is provided on the second system 
coupled to receive the difference information from the 
data store via the network, and interfacing with data on 
the second system to update said data on the second 
system with said difference information. 

Difference information is transmitted to the data 
store by the first sync engine and received from the data 
store from the second sync engine. The system may in- 
clude a management server coupled to the network and 
in communication with the first sync engine, the second 
sync engine and the data store. The system may include 
a plurality of sync engines on a respective plurality of 
systems, each of said plurality of engines being coupled 
to receive difference information from each of said first, 
second and plurality of sync engines from the data store 
via the network. Each said engine interfaces with data 
on the system on which it resides to update said data 
on said system on which it resides with said difference 
information, and interfaces with data on said system on 
which it resides to provide difference data information 
from the system on which it resides to the data store. 

In a further embodiment, the invention comprises a 
method for synchronizing at least a first file and a second 
file resident on a first and a second systems, respective- 
ly, coupled to the Internet, respectively. The method in- 



cludes the steps of: determining difference data result- 
ing from changes to the first file on the first system; 
transmitting the difference data to a server via the Inter- 
net; querying the server from a second system to deter- 
mine whether difference data exists for files on the sec- 
ond system; retrieving the difference data to the second 
system; and updating the second file on the second sys- 
tem with the difference data. 
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D scripti n 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001] The invention relates to the transference of data between two systems independent of the form in which the 
data is kept on the respective systems, and in particular to providing an efficient means of communicating data between 
systems and devices. 

10 

Description of the Related Art 

[0002] The growth of computing-related devices has not been limited to personal computers or work stations. The 
number of personal computing devices has grown substantially in both type and format. Small, hand-held computers 

15 carry a multitude of contact, personal, document, and other information and are sophisticated enough to allow a user 
to fax, send e-mails, and communicate in other ways wirelessly. Even advanced cellular phones carry enough memory 
and processing power to store contact information, surf the web, and provide text messaging. Along with the growth 
in the sophistication of these devices, the need to transfer information between them has grown significantly as well. 
[0003] With a multitude of different device types on the market, keeping information between the different devices 

20 synchronized has become increasingly problematic. For example, if an individual keeps a calendar of information on 
a personal computer in his or her office using a particular personal information manager application, the individual 
would generally like to have the same information available in a cellular phone, hand-held organizer, and perhaps a 
home personal computer. The individual may additionally have a notebook computer which requires synchronizing file 
data such as presentations or working documents between the notebook and the office computer. 

25 [0004] Until now, synchronization between both documents and personal information managers has occurred through 
direct connection between the devices, and generally directly between applications such as a personal information 
manager in one device and a personal information manager in another device or using an intermediary sync-mapping 
program. 

[0005] One example of this is the prevalent use of the 3Com Palm® OS-based organizer, such as the 3Com Palm® 
30 series of computing devices, which uses its own calendaring system, yet lets users synchronize the data therein with 
a variety of different personal information manager software packages, such as Symantec's ACT!™, Microsoft's Out- 
look®, and other systems. In this example, an intermediary synchronization program such as Puma Technology, Inc. 
's Intellisync® is required. Intellisync® is an application program which runs on both the hand-held device and the 
computer which stores the information data and maps data systems between non-uniform data records. In other cases, 
35 direct transfer between applications such as transfer between Microsoft's Outlook® computer-based client and Micro- 
soft's Windows CE "Pocket Outlook" application, is possible. Nevertheless, in both cases, synchronization occurs 
through direct connection between a personal computer and the personal computing device. While this connection is 
generally via a cable directly connecting, for example, Palm® device in a cradle to the personal computer, the connec- 
tion may be wireless as well. 

40 [0006] One component of these synchronization systems is that the synchronization process must be able to delin- 
eate between when changes are made to specific databases and must make a decision about whether to replace the 
changed field. Normally, this is measured by a change in one database, and no-change in a second database. In some 
cases, both databases will have changed between syncs. In this case, the sync operation must determine which of 
the two changes which has been made is to "win" and replace the other during the sync. Generally, this determinant 

45 of whether a conflict exists allows some means for letting the user resolve the conflict. 

[0007] In a technical sense, synchronization in this manner is generally accomplished by the copying of full records 
between systems. At some level, a user is generally required to map data fields from one application to another and 
specify which data fields are assigned to which corresponding field in a different device. Less mapping is required 
where developers more robustly support various platforms of applications. 

so [0008] In many instances, the data to be synchronized is generally in the form of text data such as records of ad- 
dresses, contact information, calendar information, notes and other types of contact information. In certain instances, 
data to be synchronized will be binary format of executable files or word processor-specific documents. In many cases 
where document synchronization is required, the synchronization routine simply determines whether or not the docu- 
ments in question have changed, and uses a time-based representation to determine which of the two files is newer, 

55 and replaces the older file with the newer file to achieve synchronization, as long as the older of the two files was in 
fact not changed. This is the model used in the familiar "Briefcase" function in Microsoft Windows-based systems. If 
both files have changed, then the synchronization routine presents the option of conflict resolution to the user. Such 
synchronization schemes are generally relatively inefficient since they require full band-width of the document or binary 
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file to be transferred via the synchronization link. In addition, at some level the synchronization programs require in- 
teraction by the user to map certain fields between different programs. 

[0009] One of the difficulties in providing synchronization between different computing devices is that the applications 
and platforms are somewhat diverse. 

s [0010] Nevertheless, all synchronization programs generally require certain functions in order to be viable for wide- 
spread usage. In particular, synchronization programs must work with popular applications on various platforms. Sync 
applications must allow for conflicts resolution when changes are made to the same information on different devices 
between syncing events. They must provide synchronization for all types of formats of data, whether it be text data in 
the form of contacts, e-mails, calendar information, memos or other documents, or binary data in the form of documents 

10 or programs in particular types of formats. 

[0011] In a broader sense, applications which efficiently synchronize data between disparate types of devices can 
provide advantages in applications beyond synchronizing individual, personal information between, for example, a 
personal information manager hardware device such as a Palm® computing device, and a personal computer. The 
same objectives which are prevalent in developing data transfer between personal information management (PIM) 

is devices and desktop systems lend themselves to furthering applications requiring data transfer between other types 
of devices, on differing platforms. These objectives include speed, low bandwidth, accuracy, and platform independ- 
ence. 

[0012] For example, current e-mail systems use a system which is somewhat akin to the synchronization methods 
used for disparate devices in that an entire message or file is transferred as a whole between different systems. When 
20 a user replies to an e-mail, generally the entire text of the original message is returned to the sender, who now has 
two copies of the e-mail text he/she originally sent out. The same is true if an e-mail attachment is modified and returned. 
All of the text which is the same between both systems is essentially duplicated on the originator's system. 

SUMMARY OF THE INVENTION 

25 

[0013] The invention comprises a system and method for efficiently, quickly and easily synchronizing devices which 
can couple to the Internet, or any network. Synchronization of the devices can occur at independent times using an 
intervening network based storage server to store changes to data for all the different devices in the system in a data 
independent format, and provide the data on request to the device requesting a sync at the time requested. Hence, 

30 two devices need not be coupled to each other to perform a sync. 

[0014] In one aspect the invention comprises a system for synchronizing data between a first system and a second 
system. The system includes a first sync engine on the first system interfacing with data on the first system to provide 
difference information. A data store is coupled to network and in communication with the first and second systems. A 
second sync engine is provided on the second system coupled to receive the difference information from the data store 

35 via the network, and interfacing with data on the second system to update said data on the second system with said 
difference information. 

[0015] Difference information is transmitted to the data store by the first sync engine and received from the data 
store from the second sync engine. The difference information is transmitted to the data store at a first point in time, 
and received from the data store at a second, subsequent point in time. In a further aspect, the second sync engine 

40 can interface with said data on the second system to provide second difference information to the data store and the 
first sync engine may thereafter couple to the data store to retrieve the second difference information and interface 
with the data on the first system to update said data on the first system with said second difference information. 
[0016] The system may include a management server coupled to the network and in communication with the first 
sync engine, the second sync engine and the data store. 

45 [001 7] In a further aspect, the system may include a first device, coupled to the first system via the network, providing 
said data to the first system. In such instance, the first system may be a sync server. 

[0018] The system may include a plurality of sync engines on a respective plurality of systems, each of said plurality 
of engines being coupled to receive difference information from each of said first, second and plurality of sync engines 
from the data store via the network. Each said engine interfaces with data on the system on which it resides to update 

so said data on said system on which it resides with said difference information, and interfaces with data on said system 
on which it resides to provide difference data information from the system on which it resides to the data store. 
[0019] In a further embodiment, the invention comprises a system including a first device, a data store and a second 
device. The first device includes at least a first data file and first differencing code having an input and an output coupled 
to a network to receive first device data change transactions, based on said at least one data file, from and provide 

55 change transactions to, said network. The data store is coupled to the network and has at least one data structure 
coupled to store change transactions. The second device includes at least a second data file and second differencing 
code having an input and an output coupled to the network to receive said first device data change transactions, and 
provide second change transactions based on said at least second data file to said data store. 
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[0020] In a further embodiment, the invention comprises a method for synchronizing at least a first and a second 
resident on a first and a second systems, respectively, coupled to the Internet, respectively. The method includes the 
steps of: determining difference data resulting from changes to the first file on the first system; transmitting the difference 
data to a server via the Internet; querying the server from a second system to determine whether difference data exists 
s for files on the second system; retrieving the difference data to the second system; and updating the second file on 
the second system with the difference data. 

[0021] In a still further aspect, the invention comprises an Internet synchronization system. The system includes a 
storage server having an Internet connection; a first device coupled to the Internet and including a device sync engine; 
and a second device coupled to the Internet and including a second device sync engine. A management server may 
10 further be provided. In this aspect, each device sync engine may comprise an application object, an application object 
store, and a delta engine. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 [0022] The invention will be described with respect to the particular embodiments thereof. Other objects, features, 
and advantages of the invention will become apparent with reference to the specification and drawings in which: 

Figures 1 - 7 are block diagrams of various configurations of the system of the present invention utilizing the 
differencing routines of the present invention. 
20 Figure 8 is an overview of one embodiment of the system architecture in accordance with the present invention. 

Figure 9A is a block diagram of the desktop device engine of the present invention. 

Figure 9B is a block diagram of the configuration of server side device engines utilized in accordance with the 
present invention. 

Figure 10 is a block diagram of one embodiment of the device engine in an operating system such as Windows. 
25 Figure 11 is a block diagram of an application object incorporated into the device engine of the present invention. 

Figure 1 2 is a diagram of storage object hierarchy of a universal data format utilized with the system of the present 
invention. 

Figure 13 is a listing of exemplary item objects used in accordance with the routines of the present invention. 
Figure 14 is a block diagram of a management storage server architecture for used in the system of the present 
30 invention. 

Figure 1 5 is a flow diagram illustrating a pull synchronization in accordance with the system of the present invention. 
Figure 1 6 is a flow diagram illustrating a push synchronization in accordance with the system of the present in- 
vention. 

Figure 17 is a diagram of the management server architecture in accordance with the present invention. 

35 

DETAILED DESCRIPTION 

[0023] The present invention includes a system and a method for transferring data between two devices which require 
information to be shared between them. In accordance with the discussion herein, a "device" is defined as a collection 

40 of elements or components organized for a common purpose, and may include hardware components of a computer 
system, personal information devices, hand-held computers, notebooks, or any combination of hardware which may 
include a processor and memory which is adapted to receive or provide information to another device; or any software 
containing such information residing on a single collection of hardware or on different collections of hardware. Such 
software might include applications such as personal information managers, which include contact data and other such 

45 information, e-mail systems, and file systems, such as those utilized by Microsoft Windows NT operating systems, 
Unix operating systems, Linux operating systems, or other systems capable of storing file types having binary formats 
which translate to application formats of differing types. 

[0024] In one embodiment, the invention comprises a set of programs specifically designed to transmit and/or receive 
differencing data from one device to another device, irrespective of the type of file system, data, content, or system 
so hardware configuration. 

[0025] In a further aspect, the system comprises store and forward technology which utilizes the differencing tech- 
nology to implement services via a public or private network, such as the Internet. 

[0026] The system of the present invention finds particular usages in synchronizing personal contact information 
between different systems, but it will be readily apparent to one of average skill in the art that the present invention 
55 provides advantages having broader applicability than merely synchronizing various types of systems. For example, 
replying and forwarding e-mail can be made more efficient by forwarding only the differences in e-mails between sys- 
tems. As a further example, updates to systems software via a network can be made more efficient where, for example, 
instead of completely replacing different modules of an application, only the differences of the modules need be for- 
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warded, resulting in more efficient use of existing bandwidth. 
System Overview 

5 [0027] Figures 1 -7 show various configuration alternatives of the present invention. 

[0028] Figure 1 shows an embodiment of the present invention in a basic configuration. In Figure 1, a first system 
or device, system A, and a second system or device, system B, are coupled by a communication line 110. It should 
be readily understood that communication line may be any direct coupling of the two systems which allows data to 
pass between the systems such as, for example, by means of serial ports, parallel ports, an Ethernet connection or 

10 other type of network, or an infrared link, or the like. System A includes a functional block 1 00 representing a differencing 
transmitter in accordance with the present invention. System B includes a functional block 102 representing the differ- 
encing receiver in accordance with the present invention. 

[0029] The differencing transmitter 1 00, upon receipt of a control signal enabling operation of the transmitter, exam- 
ines a specified data structure of information which is to be transmitted to system B. Differencing transmitter 100 

is extracts such information from System A and converts the information extracted into difference information A. Difference 
information A comprises only the changes to System B's data which have occurred on System B and instructions for 
implementing those changes. Hence, if the data to be transferred is a change to a file which exists on system B, 
difference information A comprises only the differences in such file and where such differences occur. If the data does 
not exist at all on System B, the difference information A will be the entire file. Difference information A received by 

20 differencing receiver 102 at System B is reconstructed at System B, and the changes reflected therein are updated on 
System B. 

[0030] For example, if System A and System B are two computers and an update for certain binary files on System 
A is required, the differencing transmitter on System A will extract the differences in the file known to exist on System 
B and any new files, and transmit only those differences (an instructions for where to insert those differences) to the 
25 differencing receiver 102. Differencing receiver 102 will interpret the difference information (A) and reconstruct the 
binary files on System B. In this manner, the information on System B is updated without the need to transfer the entire 
binary files between the Systems. 

[0031] Figure 2 shows a second example of the system of the present invention. In Figure 2, both System A and 
System B include functional blocks 1 04, each representing a differencing synchronizer. The function of the synchronizer 

30 1 04 is similar to that of the transmitter and receiver combined; the synchronizer wilt allow difference information A to 
be both transmitted and received. For example, System A and System B are a portable computer and a desktop 
computer, respectively, where information such as contact information needs to be synchronized between the two, the 
differencing synchronizer 104 will extract changes made to the contact information on either System A or System B 
and at predetermined times, transmit the information A between the systems, and reconstruct the data on the receiving 

35 system to update information from the sending system, in order to ensure that both systems contain the same data. 
[0032] Figure 3 shows yet another alternative embodiment of the system of the present invention. In Figure 3, System 
A again includes a differencing transmitter and System B includes a differencing receiver 102. In this embodiment, a 
storage server 300 is coupled between System A and System B. Storage server 300 may store a separate database 
of the difference information A provided by System A, which allows System A to provide its difference information A to 

^0 the storage server 300 at a first point in time, and storage server 300 to provide the same difference information A to 
System B at a second point in time, but not the same as the first point in time. In addition, multiple sets of difference 
information A may be provided at different points in time, and stored for later retrieval by System B. Still further, the 
difference information sets may be maintained on server 300 to allow data on either System A or System B to be 
returned to a previous state. 

45 [0033] Once again, the storage server 300 is coupled by a direct connection 110 to both System A and System B. 
Storage server 300 may be a server specifically adapted to receive differencing information A from the receiver 100 
and provide it to the transmitter 102. In one embodiment, server 300 includes specific functional routines for enabling 
this transfer. Alternatively, server 300 comprises standard information server types which respond to standard Internet 
communication protocols such as file transfer protocol (FTP), or hypertext transfer protocol (HTTP). 

so [0034] Figure 4 shows yet another alternative embodiment of the system of the present invention wherein System 
A and System B, once again coupled directly to a storage server 300 by a direct connection line 110, each include a 
differencing synchronizer 104. Difference information A can be passed to and from System A through synchronizer 
1 04 to and from the storage server 300 at a first point in time, and to and from System B at a second point in time. In 
this embodiment, storage server 300 may include routines, described below, for resolving conflicts between data which 

55 has changed on both System A and System B independently after the last point in times when the systems were 
synchronized. 

[0035] Figure 5 shows yet another alternative embodiment of the present invention including four systems: System 
A which includes a differencing synchronizer 104; System B which includes a differencing receiver 102; System C 
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which also includes a differencing synchronizer 1 04; and System D which includes a differencing transmitter 1 00. Each 
is directly coupled to a storage server 300, allowing control of transmission of differencing data A between the various 
systems. Server 300 may include routines, described in further detail below, to track the various types of systems which 
comprise System A through System D, and which control the transmission of various components of the difference 

5 information A to each of the various systems. For example, since System B includes only differencing receiver 102, 
the difference information A 2 which is provided to it may be a sub-component of that which is transferred between 
System A in the storage server 300, or may be simply receiving broadcast information A 4 from System D. In one 
embodiment of the system of the present invention, server 300 does not itself route the difference information derived 
from each receiver/transmitter/synchronizer. Server 300 acts as a repository for the information, and the determination 

10 of which difference information A is attributed to which receiver/transmitter/ synchronizer is made by each receiver/ 
transm itter/synch ron izer. 

[0036] Figure 6 shows yet another alternative embodiment of the present invention. In Figure 6, a synchronizer is 
provided in storage server 300. It should be recognized that a forwarder and/or receiver may be provided in server 300 
as well. The particular embodiment shown herein may be advantageous where device processing power and memory 

is are limited, such as cases where the device is a cell phone. It should be noted that the data transferred between system 
A and the device engine 1 04a in such an embodiment may or may not be difference information, depending on whether 
System A has the capacity to detect and output difference information. Each of the devices may include a differencing 
receiver, a differencing transmitter, or a differencing synchronizer. It should be understood that a portion of the differ- 
encing synchronizer 104a may reside on System A and another portion may reside on server 300. 

20 [0037] Figure 7 shows yet another alternative embodiment of the present invention wherein the devices shown in 
Figure 6 may be coupled to a combination of public or private networks 700 such as, for example, the Internet. The 
network 700 may include one or more storage servers 300 1t 300 2 , and in such cases the difference information A 
transmitted between each such device 602-610 via intermediate storage on one of such servers. Network 700 may 
couple the devices to one or more specialized function servers, such as servers specifically designed to include a 

25 differencing forwarder, receiver or synchronizer. Such devices may comprise, by way of example and without limitation, 
a personal office PC 602, a smart telephone 604, a user's office PC 606, a personal information Palm® computing 
device 608, a telephone or cellular phone 604, a home personal computer 606, or a web browser 61 0. Each differencing 
receiver, differencing transmitter, or differencing synchronizer present in devices 602-610 includes means to poll the 
data stored on storage servers 300^ 3002 to determine whether the data present at storage server 300 1 ,300 2 includes 

30 difference information which the particular receiver or synchronizer is required to have to synchronize the data on the 
device on which it resides. 

[0038] In the following description, an embodiment wherein the differencing receiver, transmitter, and synchronizer 
are described will be discussed with respect to its use in synchronizing contact information, calendar information, and 
binary file information between a plurality of different devices in the context of data synchronization. It will be readily 

35 understood that the system of the present invention is not limited to synchronization applications, or applications de- 
pendent upon specific types of data, such as contact information or scheduling information. In particular, it will be readily 
understood that the transmission of data comprising only the differences in data between two systems via routines 
which extract the data and reassemble data on the various systems, represents a significant advancement in the 
efficient transmission of data. The present invention allows for optimization in terms of a reduction in the bandwidth 

40 utilized to transmit data between two systems, since only changes to data are transferred. This consequently increases 
the speed at which such transactions can take place since the data which needs to be transmitted is substantially 
smaller than it would be were entire files transferred between the systems. 

[0039] In a particular embodiment of the present invention, the ability of devices to connect to the Internet is leveraged 
to manage data transfer between the systems. In essence, each particular device which requires information access 
45 which can connect to the Internet may become part of the system of the present invention, and synchronize its data 
with other devices defined by a user as being part of the system. 

[0040] Generally, the system comprises client software which provides the functions of the differencing transmitter 
100, differencing receiver 102, and differencing synchronizer 104 in the form of a device engine. The device engine 
includes at least one component particular to the type of device on which the device engine runs, which enables 

so extraction of information from the device and conversion of the information to difference information, and transmission 
of the difference information to the storage server. This allows the replication of information across all systems coupled 
to the system of the present invention. Although the storage servers 300 utilized in the system of the present invention 
may be any type of storage server, such as an Internet server or an FTP server, and may be provided from any source, 
such as any Internet service provider (ISP), particular aspects of a storage server which may be useful and which may 

55 be customized to optimize transfer of information between systems coupled as part of the present invention will be 
described below. Synchronization of devices utilizing the synchronization system of the present invention is possible 
as long as an Internet connection between the devices is available. 

[0041] In a key aspect of the invention, the Internet connection between the devices or between the devices and a 
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server, need not exist at the same point in time, and new devices may be added to the system of the present invention 
at any point in time without the loss of information. The system provides totally transparent access to information and 
the device engine on each device provides an operating system independent extension which allows seamless inte- 
gration of the personal information services in accordance with the present invention. 
5 [0042] In a particular unique aspect of the present invention, only those changes to the information which are required 
to be forwarded to other systems on the system of the present invention are transmitted to enabie exceptionally fast 
response times. In a still further aspect of the invention, information which is transferred in this manner is encrypted 
to ensure security over the public portions of the Internet. 

w Architecture Overview 

[0043] Figure 8 shows an overview of the architecture of the system of the present invention utilized for synchronizing 
or "syncing" information on different types of devices. In the embodiment hereinafter described, the system of the 
present invention allows the coupling of a collection of personal devices and applications one uses when working with 

15 personal information. Nevertheless, the system may be used to broadcast public or private information to various device 
types. System software in the form of a device engine for each device which is declared a part of the system of the 
invention is distributed across the collection of devices to enable synchronization. Distribution of the device engines 
may occur via, for example, an installation package forwarded over an Internet connection. In essence, the device 
engine software of the present invention forms a distributed processing network which maintains consummate syn- 

20 chronization of all information in the system. The processing load associated with delivering this service is pushed to 
the end-point devices which provides for easy scaling of the system to ever-larger applications. 
[0044] The present invention contemplates the use of two types of device engine: one totally embodied on the server 
which outputs change data to the server; and a second totally embodied on the server receiving device generated 
change information from the device. In addition, a hybrid of the two, having a portion of the device engine on the device 

25 and a portion on the server, is disclosed. 

[0045] As shown in Figure 8, any number and type of devices 802-808 may be utilized in accordance with the system 
of the present invention. A telephone 802 may comprise a cellular phone or a standard POTS-connected telephone. 
Telephone 802 may include contact information and, as is supported with a newer generation of cellular telephones, 
appointments and task data stored in a data structure 81 2. The application 812 which utilizes the application data 822 

30 comprising such information is. all stored in the telephone unit 802. Likewise, a personal digital assistant such as a 
Palm® computing device 804 includes application 814 and application data 824 which may include information such 
as contacts, appointments and tasks, and may also include file information such as documents which are created and 
stored on the PDA 804. Device 806 is represented as a Windows personal computer running an operating system 
such as Microsoft Windows 95, 98, NT or 2000. Applications 816 which may be running on device 806 include the 

35 Windows operating system itself, Microsoft Outlook, Symantec's ACT Personal Information Manager, Goldmine Soft- 
ware's Goldmine, Lotus Organizer, Microsoft's Internet Explorer web browser, Netscape's Communicator Suite, Qual- 
comm's Eudora e-mail, and various other programs, each of which has its own set of application data 826 which is 
required to be synchronized not only with devices outside the system 806, but also between devices and applications 
within the system itself. Finally, a dedicated web browser client 808 is shown which couples via the Internet to web 

40 portal applications 81 6 which have their own set of application data 828. Unlike devices 806 which store the application 
and application data substantially in their own hardware, web portal applications are provided on a separate server 
and provided to browser 808 via an Internet connection. Nevertheless, the web portal application stored on the portal 
application provider includes a set of application data 828 which a user may wish to synchronize. For example, a large 
web portal such as Yahoo! and Snap.com provide services such as free e-mail and contact storage to their users. A 

45 user may wish to synchronize this with applications running on their cellular phone, PDA, or Windows devices. 

[0046] In order to access the specific application data of each of the systems shown in Figure 8, a device engine is 
associated with each type of device. A cellular device engine 862 communicates and incorporates itself with the ap- 
plication data 822 of the cellular phone. Likewise, a PDA device engine 864 is provided, which may be based on either 
the Palm® operating system, Windows CE operating system, or other PDA-type operating systems as necessary. A 

so Windows-based device engine 866 includes a mechanism, discussed below, for extracting application data 826 from 
supported Windows applications 816, and a web services device engine 868 incorporates to extract application data 
828 from web portal applications 818. 

[0047] As shown in Figure 8, some device engines are provided entirely oh the device (and are referred to herein 
as desktop device engines), while others include components a the back end server (which may comprise storage 
55 server 850 or a specialized server, as shown in Figure 9B.) This is illustrated generally by lines 832, 834,836, and 838 
in Figure 8. Also, in Figure 8, elements above dashed line 855 are provided by an administrator or service provider of 
the system of the present invention. Each of the device engines 862, 864, 866 and 868 is configured relative to the 
type of device on which it resides. For example, the Cell phone device engine 862 includes one or more components 
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arranged on the phone while others are on server 850. Conversely, device engine 866 resides entirely on the windows 
device 806. 

[0048] Data from each of the devices is coupled via an Internet connection 71 0 with a storage server 850. As noted 
above, storage server 850 may be a generic storage server or it may be a storage server specifically adapted for use 

5 with the system of the present invention as discussed below. One or more of the storage servers 850 are used to 
communicate transactions amongst the collection of systems 802, 804, 806, 808. It should be readily recognized that 
any number of different types of systems 802, 804, 806, 808 may be provided in accordance with the present invention 
and incorporated into the system. However, for brevity, not all the different types of commercially available computing 
devices which are currently in use or in development, in which the system of the present invention may be incorporated, 

10 are listed. 

[0049] In its simplest embodiment, the storage server 850 is simply a dumb storage server and each of the device 
engines transmits only difference information thereto to be stored in a particular location accessible by other device 
engines in the system. In one embodiment, each device engine implements all processing required to keep all the 
systems fully synchronized. Only one device engine needs to be coupled to the storage server 850 at one particular 
15 point in time. This permits synchronization of multiple systems in a disconnected fashion. Each device engine will 
download all transactions encapsulating changes that have occurred since the last synchronization from the server 
and apply them to the particular device. 

[0050] The change or difference information (A) is provided in one or more data packages, the structure of which is 
described herein. Each data package describes changes to any and all transfer information across all device engines, 

20 including but not limited to application data, files, folders, application settings, and the like. Each device engine can 
control the download of data packages that include classes of information that apply to the specified local device 802, 
804, 806 or 808 attached to that specific device engine. For example, device engine 862 will only need to work with 
changes to information describing contact names and phone numbers in application data 822, while device engine 
866 will be required to work with changes to e-mail, changes to document files, notes, as well as contact and address 

25 information since the application data 826 is much more extensive than application data 822. 

[0051] Each device engine includes compression/decompression and encryption/decryption components which al- 
low encryption and/or compression of the data packages transmitted across Internet connection 71 0. It should be 
recognized that compression and encryption of the data packages may be optionally provided. It is not required in 
accordance with the present invention. Each device engine performs mapping and translation steps necessary for 

30 applying the data packages to the local format required for that type of information in the application data stores 822-828. 
The device engine also includes components which allow it to track ambiguous updates in cases where users have 
changed data to a particular data field on two different systems simultaneously since the last update. In this case, the 
device engine includes a mechanism for drawing this to the attention of the user and allowing the user to resolve the 
conflict. 

35 

Device Engine Architecture 

[0052] Figure 9A illustrates a single device engine utilized with a generic application 81 0 and a generic storage server 
850. Figure 9A illustrates a desktop device engine, since all processing occurs on the device and only difference 
40 information is transmitted to server 850. Nevertheless, an understanding of the desktop device engine will aid in un- 
derstanding server side devices engines, hereinafter described. Shown in Figure 9 are the functional components of 
a device engine in block form and their interrelationship to each other. The device engine 860 is equivalent to the 
functional block of a differencing sequencer 104 shown in Figures 1-7. 

[0053] While the invention will be described with respect to the embodiment of the invention as a differencing syn- 
45 chronizer 1 04, it will be readily understood that portions of the functionality are utilized as needed in a forward-only (a 
differencing transmitter) or a receive-only (a differencing receiver) capacity as required by the particular application. 
[0054] As noted above, a device engine exists for each and every device that makes up a user's personal information 
network of devices in the system. As shown in Figure 9A, each device engine 860 includes an application object 910. 
The application object is specific to each particular application 810 and provides a standard interface between the 
so device engine and the balance of the data transmission system of the invention, and the application 810. Details of 
the application object will be described in further detail below. The application object is a pluggable architecture which 
supports a wide variety of vendor-unique applications. The job of the application object is to map data from the appli- 
cation into a temporary or "universal" data structure by connecting to the application via any number of standard inter- 
faces to gain access to the applications data. The data structure of the application object puts the data in a generic or 
55 ^universal data" format which may be used by the device engine components to generate data packages for provision 
to the storage server. 

[0055] Also provided is an application object store (AOS) 920 which includes a copy of the device's data at a point 
just after the previous data extraction and synchronization occurred. Application object store 920 is a mirrored interface 
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which stores a snapshot of the previous state of the data from the application object 910 in the device engine. The 
size of the AOS will depend on the data being collected by each device engine. 

[0056] The generic output of the application object is provided to a delta module 950. Delta module 950 is a differ- 
encing engine which calculates differences in data between the output of the application object 910 and the copy of 

5 the data which is provided in an application object store (AOS) 920. The actual differencing and patch routine can 
comprise a routine such as XDelta or YDelta. The delta module 950 will be referred to herein alternatively in certain 
portions of the description as "CStructuredDelta." In addition, the difference information is alternatively referred to 
herein as a "change log." Each change log (or set of difference information) is a self describing series of sync trans- 
actions. As described below, the change log may be encrypted and compressed before output to the network. 

10 [0057] Hence, during a sync, the Application Object will, using a mechanism discussed below, extract the data of 
each application in the device and convert it to a universal data format. The delta module will then generate a difference 
set by comparing the output of the Application Object and the AOS. This difference information is forwarded to the 
encryption and compression routines for output to the storage server 850 in the form of a data package. Alternatively, 
the data from one application can be used to synchronize to data in another application in, for example, a windows 

is environment, as shown by arrow 1050 in Figure 10. 

[0058] It should be specifically noted that the application object may interface directly unstructured binary data or 
with structured application data. The differencing routine supports both uses of the delta module 950 in comparison 
generation. 

[0059] In some cases, operation of the application object and delta module is simplified by the fact that some appli- 
20 cations, such as PDA's, have the ability to output changes to its data. In such cases, the delta module 950 need only 
provide the data into the data package, since comparison to an AOS is not required - the application already includes 
a mechanism for tracking changes made to its own data. However, in many cases the applications provide, at most, 
a standard interface to access the data, such as Microsoft's OBDC interface, the Microsoft standard Application Pro- 
gramming Interlace (API), or other similar standard interfaces. 
25 [0060] Device engine 860 further includes a versioning module which applies a version number per object in the 
data package. As explained further below, each object in the data package is assigned a universally unique ID (UUID). 
Hence, unlike many prior synchronization systems, the system of the present invention does not sync data solely by 
comparing time stamps of two sets of data. Versioning module 915 allows each device engine to check the state of 
the last synchronization against data packs which have been provided to the storage server to determine which data 
30 packages to apply. This allows the device engine to sync itself independently of the number of times another device 
engine uploads changes to the storage server. In other words, a first device engine does not care how many. times a 
second device engine uploads data packages to the server. 

[0061] An events module 925 controls synchronization initialization events. Items such as when to sync, how to sync, 
trigger the delta module 950 to perform a synchronization operation. 
35 [0062] A user interface 930 is provided to allow additional functional features to a system user of the particular device 
to which the device engine 860 is coupled. The user interface is coupled to a conflict resolution module 940, a filtering 
module 945, and a field mapping module 935. Each of the modules provides the functionality both necessary for all 
synchronization programs, and which users have come to expect, 

[0063] Filtering module 945 allows filtering for types of content based on, for example, a field level content search. 

40 The field mapping module 935 allows for the user to re-map certain interpretations of items which were provided in the 
document stream. For example, if the device engine 860 is operating on a personal computer, and a synchronization 
is occurring between the personal computer and a notebook computer, and the user has a "my documents" directory 
on the personal computer which he wishes to map to a different directory on the notebook computer, the field mapping 
module 935 allows for this re-mapping to occur. It should be recognized that the field mapping module allows for 

45 changes in directing the output of the data package. The field mapping module 935 is not necessary to map particular 
data fields of, for example, contact information from one application, such as Microsoft Outlook, to a different application, 
such as Symantec's ACT, as is the traditional use of field mapping and synchronizing applications. 
[0064] Delta module 950 is further coupled to a compression module 970 and an encryption module 960. It should 
be recognized that the compression encryption modules need not be enabled. Any type of compression module 970, 

50 such as the popular PK Zip or Winzip modules, or those available from HiFn Corporation may be utilized in accordance 
with the invention. Moreover, any type of encryption algorithms, such as MD5, RCH 6, Two Fish, or Blowfish, or any 
other symmetric encryption algorithm, may be utilized. In one embodiment of the invention, encryption without com- 
pression is used. In a second embodiment of the invention, compression without encryption is used. In a third embod- 
iment of the invention, neither compression or encryption is used, and in a fourth embodiment of the invention, both 

55 compression and encryption are used. 

[0065] Versioning module 915 also allows the device engine 860 to support multiple users with distinct synchroni- 
zation profiles. This allows multiple users accessing the same machine to each synchronize their own data set using 
the same device engine. For example, if the application 810 on a particular device comprises Microsoft Outlook on a 



9 



EP1 130 511 A2 



personal computer, coupled to a Microsoft Exchange server, and Outlook is configured to have multiple user profiles, 
versioning module 915 will track the data applied through the device engine when a sync request occurs. This allows 
two users of the same Outlook client software which access different data sets, either in the client computer or on a 
separate server, to utilize the same device engine and the system of the present invention via the same machine. In 

5 a further embodiment, a particular device engine supports the use of foreign devices accessing the system via the 
same connection. Palm® devices, for example, use a cradle to connect to a computer and/or Internet connection. If a 
particular user wishes to allow another user to use his Palm® pilot cradle connection to synchronize the other user's 
Palm® pilot, the device engine can generate data packages to update the local application object store for the foreign 
device. The application object store can therefore be used as a temporary storage for cases allowing synchronization 

10 of foreign devices. 

[0066] The output of the device engine 900 comprises a data package which is output to storage server 850. As 
noted above, only one device engine need be connected to the storage server 850 at a given time. The data package 
can be stored on the storage server 850 until a request is made to a particular location of the storage server by another 
device engine. Likewise, delta engine 900 can query alternative locations on the storage server for access to synchro- 
15 nized data within the system of the present invention. Access to areas of the storage server is controlled by a man- 
agement server (MS) described more fully below. In one embodiment, each sync operation requires that the device 
engine for each device login to the management server to authenticate the device and provide the device engine with 
the location of the individual device's data packages on the storage server. 

[0067] Data packages may be advantageously provided to the device engine from the storage server in a streaming 

20 format, allowing processing to occur using a minimum of bandwidth and storage in the devices. The device engine 860 
and particularly the delta module 950 interpret data packages based on the versioning information and the mirrored 
data present in the application object store 920. When data is returned to the delta module 950 from the storage server 
850, the delta module returns differenced data to the application object 910 for the particular application which then 
translates the delta information into the particular interface utilized for application 810. Once a device engine has been 

25 fully applied all data packages from an input stream, it generates a series of data packages that describe the changes 
made on the local system. The device engine uses the local application object store 920 to keep track of the last 
synchronized version of each application's actual data, which is then used for the next data comparison by the delta 
module on the next sync request. Generated data packages can include operations and encode changes generated 
from resolving ambiguous cases as described above. 

30 [0068] Figure 9B depicts how server based device engines may be provided in the system of the present invention. 
The Palm® device example is shown in this embodiment, where the Palm® device has the capability of connecting 
directly to the Internet and a service provider's data center 900. The data center includes a firewall 975 to prevent 
unauthorized communications with servers resident in the data center 900 and protect integrity of the data. The storage 
server 850 may communicate directly through the firewall as may the management server (MS) 1410. 

35 [0069] Shown therein are two sync servers 982 and 984 each of which is dedicated to syncing one particular type 
of application. Sync server 982 is dedicated to the Palm® device, while sync server 980 is dedicated to, for example, 
a portal application (PortaH). 

[0070] Since the Palm® Device 804a includes a mechanism for transmitting changes to its data directly, data may 
be transmitted using HTTP request and response via the firewall 975 to the sync server 982 where differencing and 

40 updating of data in the AOS can occur, after which changes can be downloaded to the Palm® 804a. 

[0071] The synchronization server is an application handles concurrent synchronization of user's data. Each Sync 
Server includes plug-in support for multiple devices to be synchronized using the same sync server executable. Each 
device type has it's own device name that identifies which AO / AOS components will be used during the sync. 
[0072] The sync server uses the concept of a universal data record in its internal sync differencing engine and when 

45 sending data to and retrieving from external entities such as the AOS and AO. Hence, in the Palm® application, the 
job of a server AO is simply to take the device-specific format of its record and convert into a universal record format. 
[0073] The Sync Server has a plug-in architecture so that 3rd party application partners can easily add their services 
into the server. Currently, if the server is operated in a Microsoft Windows NT Server, the sync server discovers the 
sync components via the Windows NT registry. In alternative embodiments, this function is performed in a Component 

so Manger which operates on each sync server to manage processing by each of the AO and AOS on the server. Each 
AO and AOS are implemented as a stand-alone DLL that the Sync Server loads at initialization time, or when adding 
a new component via the Component Manager. 

[0074] Each sync server is shown as dedicated to a single application. However, a sync server may handle multiple 
device types. 

55 [0075] In the embodiment of Figure 9B, it should be noted that, depending on the device type, there are different 
configurations for the AOS and AO's. For example, the Palm®'s AO data store 1 050 resides on the Palm® device 804a 
itself and a separate AOS data store 1052 exists for this configuration (an Oracle database). In the case of PortaH, 
the AOS and AO use the data store 1054. 
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[0076] Device engines can generate additional data packages intended to resolve synchronization problems in other 
systems. For example, interfacing with the conflict resolution module 940, if the user makes a change to a particular 
data store on an application object on his Palm® pilot, then makes an additional change to a personal information 
manager (PIM) application on his personal computer, the user can specify that the change made on the personal 
5 computer will "win" when the conflict is detected by the A engine and the versioning information between the two 
devices. This is essentially a definition that one particular set of data is correct and should replace the second set of data. 
[0077] Figure 10 shows a specific embodiment of a desktop device engine utilized in, for example, a Microsoft Win- 
dows-based operating system environment. 

[0078] As shown in Figure 1 0, a Windows operating system may have at least three specific applications which may 
10 require synchronization. In Figure 1 0, the system includes Netscape Communicator application 1 040 having data such 
as bookmarks 1021, contacts 1022, and e-mail 1023; a Microsoft Outlook application 1042 which includes contact 
information 1024, calendar information 1025, e-mail information 1026, note information 1027, and tasks information 
1028; and Windows operating system 1044 information including Favorites data 1029, file system information 1030, 
and individual files 1 031 . 

15 [0079] Each particular application 1040, 1042, 1044 has an associated application object 1010, 1012, 1014. Each 
of the respective application objects provides data back to delta module 950 in a generic format which is usable by the 
delta module in accordance with the foregoing description of the apparatus shown in Figure 9A. From Figure 10, it will 
be additionally seen how the delta module 950 may be utilized to synchronize data between applications running on 
the same particular server. The device engine hence does an intra-system sync such as, for example, between the 

20 contact information 1 022 from Netscape and the contact information 1 024 from Outlook. 

[0080] Figure 1 0 further illustrates the modularity of the system of the present invention allowing the device engine 
to include any number of different application objects to be provided on a single device to incorporate all applications 
run on that device. 

[0081] In operation, during an installation of a device engine into a particular system, the installation program may 
25 be tailored to provide application objects which may be present on a given system. For example, and with reference 
to Figure 10, the installation program for a Windows machine will carry any number of application objects for systems 
and applications which may be present on a Windows machine. The installer will check for the presence of given 
applications, and allow the user to add additional applications which may be installed in locations that are not the 
normal default installation areas for application support by the application objects which the installer is carrying, or de- 
30 select certain applications which, for one reason or another, the user may not wish to install an application object for 
and render a part of the system of the present invention. 

Application Object Structure 

35 [0082] Figure 11 is a conceptual depiction of the structure of an application object. As noted above, the application 
object is a pluggable architecture which supports a wide variety of vendor-unique applications. The consistent and 
scalable architecture of the system of the present invention for device engines is maintained by encapsulating system- 
dependent knowledge in a single component, i.e. the application object. As noted above, every application object 
supports a standard set of interfaces that every device engine understands. Each application object maps these stand- 
ee ard interfaces of the capabilities of a particular vendor application. Hence, there will be as many application objects as 
there are application types. 

[0083] As noted above, there are different types of server and desktop device engines, some having application 

objects entirely on the server, while others have application objects entirely on the desktop. 

[0084] Each application object will include a connector 1110 which may comprise a generic interface to the particular 

45 application for which the application object store has been designed. For example, when connecting to a Palm® device, 
the connector will be an HTTP protocol request routine which interfaces with the Palm® device's own built-in synchro- 
nization manager, which provides an output of records which have been changed on the Palm® device. As in Figure 
9B, since the Palm® outputs all the changes to its data via its own sync manager, in the Palm® application, the job of 
a server AO is simply to take the device-specific format of its record and convert into a universal record format. 

so [0085] The connector provides access for the application object to remove the data field from a particular application 
and convert it to a universal record structure. In the desktop AO, where, for example the application object is designed 
for a Windows interface, the connector may be the Windows API and the job of the AO will be to translate data from, 
for example, the windows file system to a universal data format. This universal data structure is then used by the delta 
module 950 to build data packages to be used in synchronization between components of the systems provided in the 

55 network system of the present invention. 

[0086] Universal data structure mapping, used on desktop application objects, and universal data record mapping, 
used by the server device engines, is further detailed below. 
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Desktop Application Object 

[0087] Each Application Object (AO) is a software component that interfaces with the third party application APIs 
(Application Programming Interface) to provide the programming services to the delta module for extraction and dep- 
5 osition of information data from and to the third party application domain during synchronization. In addition, the AO 
maps the third party application data fields to system's domain. 

[0088] The AO service is a collection of COM (Component Object Model) objects that can be developed in conjunction 
with the third party Windows application APIs as a form of a DLL (Dynamic Linked Library) in C or C++. The DLL is 
loaded on demand at runtime during synchronization. It should be recognized that the application object need not be 
10 implemented using the COM model, but may be developed with other distributed object models. 

[0089] There are a number of the related subsystems and documents that the developer must be familiar with and 
this document has made many references to those subsystems during the course of presenting the AO. 

o Change Log (CL) (or differencing information) , a data file which contains a series of synchronization transactions. 

75 o DataPack, a compacted and encrypted Change Log. 

o StructuredDelta, the delta module differentiation engine that generates differences between Application Objects 
and Change Log and AOS. 

o AOS, a database which resides locally on, for example, a windows machine. 

o MS, a management server that manages users' accounts. 

20 o ss, an FTP or storage server that manages data packs. 

o User Manager, a standalone Windows client Ul program that manages the synchronization process. 

o ePortal, a web-based PIM portal site. 

° pio_types.h, a header file which contains the definitions of the system's supported data fields known as tags. 

o Def.h, a header file contains the definitions of the system's constants. 

25 o interfaces.h, a COM interface file contains AO interface definitions. 

[0090] Each AO has a COM interface-based design built-in. That is, instead of providing a set of traditional APIs as 
programming services, it provides a set of interface-based objects as programming services. 
[0091] StructuredDelta, the delta module, the primary intended user of each AO. StructuredDelta instantiates these 
30 COM objects and uses them throughout the synchronization session exclusively through the COM interfaces on those 
objects to interface with the third party application database. 

[0092] Each AO component consists of a set of objects that translate the third party application data into the universal 
data middle format which underpins the entire spectrum of PIM data regardless of which third-party application the 
data comes from. The objects in universal data format are device, (application) data class, store, folder, item, and 

35 data fields. The AO digests the third party application data of any kind and reduces it into a few handful simple objects 
and field types. These objects and field types are fed into StructuredDelta engine and are compared by StructuredDelta 
in order of their hierarchy. The resulting differences (add, delete, modify) are logged as transactions in the difference 
information. The data packs are transported to a storage server that may be actively managed by a management server 
for each individual user account and devices. 

40 [0093] StructuredDelta uses AO objects to access and modify the individual AO objects and data fields. AO objects 
serve as a buffer between individual application data and StructuredDelta so that StructuredDelta does not require 
knowledge of each application and database. All AO objects are temporary and created in the space of each AO by 
StructuredDelta through COM interfaces. AO objects are referenced when they are in use and they are freed when 
StructuredDelta stops using them. One can think of AO objects as merely placeholders of each application objects for 

45 StructuredDelta to access. Once StructuredDelta has a particular Application's data, StructuredDelta would free AO 
objects immediately without storing them internally. 

AppObj 

so [0094] AppObj is a root object of each AO component and there is one and only one per AO. AppObj provides an 
entry point into the individual application's database. StructuredDelta instantiates it and holds it on during the entire 
synchronization session and releases it afterward. AppObj offers a number of services such as what class of data it 
supports. The C++ example of AppObj's definition is shown below: 

55 
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class CMyFlAppObj : 

public Item, 
public AppObj, 
protected Moduleldentity, 
protected DataClassInfo, 
protected ItemTypelnf o, 
protected ItemFieldMap, 
protected Folderlnfo, 
protected DataFilelnf o, 
protected SynchNotify, 
protected ErrorMsg, 
protected Enumltems, 
protected Findltem, 
protected Modifyltem 



public: 

CMyAppObj { HWND hWndParent ) 
-CMyFppObj ( ) ; 



20 

[0095] AppObj can contain children objects. They are Store objects. Enumltems interface is used to enumerate 
Store objects. Findltem interface is used to find the contained objects. Modifyltem interface enables AppObj to create 
a new Store object. AppObj is created by Structured Delta calling Create AppObjectf HWND hWndParent, AppObj 
**ppObj). 

25 

Store 

[0096] The Store object represents a database of the individual application information. If the individual application 
can handle multiple databases at same time, one needs multiple Store objects. One can think of Store object as a 
30 specialized Folder object, the root folder of each particular application data domain. The C++ example of Store's def- 
inition is shown below: 



class CMyStore : 

public Item, 

35 public ItemContainer, 

protected Enumltems, 
protected Findltem, 
protected FindltemByData, 
protected Modifyltem, 
protected ReadWrite 

40 t 



45 CMyStore ( ) ; 

-CMyStore U 



so [0097] Store is a container of Folder objects. Enumltems interface enables the enumeration of its contained folders 
while Findltem and FindltemByData interface is used to find contained Folders or Item objects. Modifyltem and 
ReadWrite interface enables the modification of each application database. 

Folder 

55 

[0098] Folder object is a specific data class of each individual application such as a table in the relational database 
or a collection of data records in each application. For example, the applications contact collection can be thought as 
a Folder object. The C++ example of Folder's definition is shown below: 
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class CMyFclder : 

public Item, 
public ItemContainer , 
protected Enumltems, 
5 protected Findltem, 

protectee FindltemByData, 
protected Modifyltem, 
protected ReadWrite 

( 

public : 

10 CMyFolder (); 

-CMyFolder {) ; 



15 [0099] Folder object is also container. It can contain Item objects as well as Folder objects. Enumltem interface 
allows the enumeration of either Folder objects or Item objects or both. Findltem and FindltemByData interface is 
used to find contained Folder objects or Item objects. Modifyltem and ReadWrite interface enables the modification 
of an application's data tables. 

20 item 

[0100] Item object represents an individual entity of each application's domain specific data. Item object can be 
thought as a record of each application's relational table. For example, a contact, email, calendar, to-do item in the 
particular application can be thought of as an Item object. The C++ example of Item's definition is shown betow: 

25 

class CMyltem : 

public Item, 
protected Enumltems, 
protected Findltem, 

30 

protected Modifyltem, 
protected ReadWrite 

{ 

public: 

CMyltem <) ; 
-CMyltemC ) ; 

35 } . 



[0101] Item can contain Attachment objects only. Enumltems interface enables the enumeration of Attachment ob- 
40 jects if any. Modifyltem and ReadWrite interface enables the modification of an application's records or data fields. 

Attachment 

[0102] Attachment object is a specialized Item object that encapsulates an attachment data or relationship. Only 
45 item can have Attachment objects. Attachment object can be thought as attachment data such as attached-email files. 
Attachment can also be thought as attachment relationship to other Item objects. The example of that is the distribution 
list (Item object) can contain contacts (Item objects). The C++ example of Item's definition is shown below: 



class CMyltemAttachment : 
public Item, 
protected ReadWrite, 
protected Modifyltem 

{ 

public : 

CMyltemAttachment { ) ; 
-CMyltemAttachment ( } ; 

); 
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Variant 

[0103] Variant object represents a data field of each particular application data. For example, a 'first name' of a 
contact or the birthday date of a contact can be thought as Variant object. StructuredDelta only understands Variant 
object and the types of data fields it encapsulated. Variant object can contain any one of the following data field type: 



struct Variant 
{ 

enumFieldTag tag; 
enumFieldDataFlag flag; 
known or otherwise special 
union 
{ 

short int 

LONG 

DWORD 

unsigned int 64 

UUID 

DATE 

LPTSTR 
eFieldType_String 

Binary 

Float 

Double 
eFieldType_Double 

FICollection 
eFieldType_Col lection 
} Value; 

Stream* strm; 

}; 



// flags item fields as net 



i; // eFieldType_WORD 

1; // eFieldType_LONG 

dw; // eFieldType_DWORD 

qw; // eFieldType QWORD 

uuid; // eFieldTypeJJUID 

time; // eFieldType_DATE 

ps z ; / / 

bin; // eFieldType_Binary 

fit; // eFieldType_Float 

dbl; // 

coll; // 



// eFieldType_Stream 



[01 04] Variant: :tag is an identification tag of data field and variant: :f lag specifies the type of data field white Variant: : 
value member variable stores each application's field value. One data field type is Collection. Collection object is an 
array of Variant objects. It can be used to represent a compound data fields. 



struct Collection 
{ 

ULONG cValues; 

struct_Variant** paVar; // This array really 

contains cValues entries 
}; 



[0105] Another data field type that is worth exploring is Binary. Binary object can be used to represent a binary data 
as it is. 



struct Binary 
< 



ULONG 
LPBYTE 

}; 



cb; 
lpb; 
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AO Interfaces 

[0106] Each AO object has an AO COM interface. Each object must implement some of those interfaces to create 
certain capability or desired behavior that are expected by StructuredDelta. 

litem 

[0107] This is the base interface of all application objects. It provides the identification service to StructuredDelta. 
Every object must have a unique ID, parent unique ID, display name, and item type information (eltemType_FOLDER, 
eltemType_CONTACT, etc). The unique ID is a unique string only in a given device. It is not persistent cross the Internet 
to other devices. The ID usually comes from the third party application database domain such a unique ID of a record. 

interface litem : IUnknown 

{ 

STDMETHOD_ (LPCTSTR, GetUniquelD) () const PURE; 
STDMETHOD_ (LPCTSTR , Get Parent UniquelD) {) const PURE; 
STDMETHOD_ ( LPCTSTR , Get DisplayName ) f) const PURE; 
STDMETHOD_(enumItemType, GetltemType) () const PURE; 
STDMETHOD_(BOOL, IsContainer) O const PURE; 
STDMETHOD_ (DATE, GetLastModi f icat icnTime ) (} const PURE; 
STDMETHOD_ (QWORD, Get Size) () const PURE; 
STDMETHOD__ ( DWORD, GetFiags) () const PURE; 

}; 



HtemContainer 

[0108] This is the base interface of all application container objects (store, folder). These container objects must 
have this interface implemented so that StructuredDelta would recursively descend in them if they have HtemContainer 
capability. 



interface HtemContainer : litem 
f 

STDMETHOD_ {BOOL, ContainsItemType ) ( enumltemType eltemType ) PURE; 
STDMETHOD_(BOOL, ContainsDataClass ) ( enumDataClass eDataClass ) 

PURE; 



STDMETHOD_ (enumSpecialFolderType, GetSpecialFolderType) {) PURE; 
STDMETHOD_ (GUID, GetMappingGUI D) (> PURE; 

) ; 



lErrorMsg 

[0109] This is an error- reporting interface for every application object. It is used by StructuredDelta to query the error 
string after a failure. The AO should implement this on every object after the error occurs and before returning the 
control to StructuredDelta. 

interface IErrorMsg : IUnknown 
{ 

STDMETHOD (GetErrorSt r ing ) { LPTSTR pszError, int iBufLen ) 
const PURE; 
I; 



16 



EP1 130 511 A2 



lEnumitems 

[01 1 0] This is an interface for collection enumeration, used by Structured Delta to enumerate the objects of the third 
party application database. lEItemEnumFlags (eftemEnumFlags_FOLDER, eltemEnumFlagsJTEM, and 
5 eltemEnumFlags_ATTACHMEN~T) is used to enumerate only the requested type of objects. 

interface lEnumitems : IUnknown 
{ 

STDMETHOD (ItemQueryStart ) ( enuml temType type, long 
10 ilCount, eltemEnumFlags dwFlags ) PURE; 

STDMETHOD [ItemQueryNext) ( Item **ppltem ) PURE; 
STDMETHOD ( ItemQueryFinish) ( ) PURE ; 

}; 



15 

IFindltem 

[0111] This is an interface for recursively finding object within the third party application database, used by Struc- 
turedDelta to find application object by its unique ID. 

20 

interface IFindltem : IUnknown 

{ 

STDMETHOD { FindStoreBylD) ( LPCTSTR pszUniquelD, I temContainer 
**ppFolder ) PURE; 

25 STDMETHOD { FindFolderBylD) ( LPCTSTR pszUniquelD, I temContainer 

**ppFolder ) PURE; 
STDMETHOD ( FindltemBylD) { LPCTSTR pszUniquelD, Item **ppltem ) 
PURE; 



30 

}; 



35 

IFindltemByData 

[01 12] This is an interface for recursively finding the object that matches the search criteria data. The search criteria 
are represented as Collection that allows the multiple search field keys to be used during the search. The multiple 
40 objects may be found that match the search criteria. The interface also provides enumeration capability of the search 
results. 



interface IFindltemByData : IUnknown 

45 STDMETHOD (FindByDataStart) ( enuml temType type, Variant* 

pSearchKey, int* pnFound ) PURE; 

STDMETHOD (FindByDataNext) ( LPTSTR pszEntrylD, int 
cbBufSi2e ) PURE; 

STDMETHOD ( FindBy Data Finish) f ) PURE; 

}; 

50 



IModifyltem 

[01 1 3] This is an interface for StructuredDelta to add, delete, and re-parent application data in the third party database 
55 during synchronization. 
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10 



15 



interface IModifyltem : IUnknown 
{ 

STDMETHOD (Add) ( BOOL bFolder, enumltemType type, Item 
**ppltem ) PURE; 

STDMETHOD (Delete) () PURE; 

STDMETHOD (Move) ( ItemContainer * pDest Folder } PURE; 



IReadWrite 

[0114] This is an interface for accessing, writing, and mapping the third party application data fields by Structured- 
Delta, it provides the capability of read and write data fields from and to the third party application database and the 
capability of mapping data field of the third party application to universal data format of the system of the present 
invention. Any object that has data fields and require field level synchronization must implement this interface. 



interface 

{ 



IReadWrite 



IUnknown 



20 



25 



STDMETHOD (Read) () PURE; 
STDMETHOD (Commit) {) PURE; 

STDMETHOD (Get FieldData ) ( enumFieldTag fieldTag, Variant 
**ppVariant ) PURE; 

STDMETHOD (ReleaseFielriData) ( Variant *pVariant ) PURE; 
STDMETHOD (Set FieldData ) ( const Variant *pVariant ) PURE; 



30 



lAppObj 



35 



[0115] This is an AppObj only interface. It provides the capability of logon and logoff to the third party applications 
during synchronization. The data class filter mechanism is used by StructuredDeltato filter the enumeration of contained 
data classes (eDataClass_CONTACT, eDataClass„CALENDAR, etc). 



40 



45 



interface IAopObj : IUnknown 
{ 

STDMETHOD (Logon) ( HWND hWndParent ) PURE; 
STDMETHOD (Logoff ) () PURE; 

STDMETHOD (SetFilter) ( const VOID* pFilter, int BufLen ) 

PURE; 

STDMETHOD_ ( int , GetFilter) ( VOID* pFilter, int BufLen ) 

PURE; 
}; 



IModuleldentity 

50 [01 16] This is an AppObj only interface. It provides DLL module identification information to the Manager object such 
as the name of the third party application, enum ID of this application, and the application installation detection support. 



55 
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interface IMoculeldent ity : IUnknown 
{ 

STDMETHOD (GetName) ( LPTSTR pszName, int iBufLen ) const 

PURE; 

STDMETHOD £ Ge tAppl ) ( Appl *pAppl } const PURE; 

STDMETHOD { I sins tailed) { BOOL *bl slnstalled ) const PURE; 

}; 



10 



15 



HtemTypelnfo 

[0117] This is an AppObj only interface. It provides the information on the number of item types supported by AO, 
what type items are supported and the capabilities for a specific item type. This returns a DWORD containing bits set. 



interface HtemTypelnfo : IUnknown 
( 

STDMETHOD (GetSupportedTypesCount) ( int SiCount ) PURE; 

STDMETHOD (GetSupportedTypelnfo) ( int ilndex, enurnltemType 
fitype, LPTSTR pszTypeName, int iBufLen ) PURE; 

STDMETHOD (GetltemTypeCaps) ( enurnltemType type, DWORD 
S-dwFlags ) PURE; 

); 



25 



30 



35 



IDataClasslnfo 

[01 18] This is a CAppObj only interface. It provides the information on the number of data classes that are supported 
by the application object and what the data classes are supported 

interface IDataClasslnfo : IUnknown 
{ 

STDMETHOD (GetCount) ( int *piCount ) PURE; 
STDMETHOD (GetDataClass) ( int ilndex, enumDataClass 
*peDataClass ) PURE; 

}; 



40 IPataFilelnfo 

[0119] This is a CAppObj only interface, it provides information on the number of database files and database filena- 
mes supported by AO to avoid being synched twice by application sync and file-set sync. 

45 

interface IDataFilelnf o : IUnknown 

{ 

STDMETHOD (GetDa taFi leCount ) ( int *piCount ) PURE; 
STDMETHOD (Get Data File Path ) ( int ilndex, LPTSTR 
pszFilePath, int iBufLen ) PURE; 



UtemFieldMap 

55 [01 20] This is a CAppObj only interface that is used by Structured Delta to query the data fields of given application 
object. For example, what are data fields in application object called eltemType__CONTACT? 
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interface I IteraFieldMap : IUnknown 
{ 

STDMETHOD (FieldQueryStart) { const enuml temType Stype, int 
siCount ) PURE; 



STDMETHOD (FieldQueryNext) ( enumFieldTag fifieid, LPTSTR 
10 pszName, int iSufLen, LPTSTR pszType, int iTypeBufLen )PURE; 

STDMETHOD(FieldQueryFinish) * () PURE; 

}; 



15 

IFolderlnfo 

[0121] This is a CAppObj only interface, used by StructuredDelta to obtain the special and default folders' unique 
IDs and UUIDs. 

20 

interface IFolderlnfo : IUnknown 
{ 

STDMETHOD (GetSpeciaiFolderlD) ( enumSpecialFolderType 
eFolder, LPTSTR pszUniquelD, int iBufLen ) PURE; 
25 STDMETHOD (Gee Default Folder ID) ( enumltemType type, LPTSTR 

pszUniquelD, int iBufLen ) PURE ; 

STDMETHOD (MapFolderGUID) ( UUID uuidFolder, LPTSTR 
pszUniquelD, int iBufLen ) PURE; 
} ; 

30 



IFastSync 

[0122] This is a CAppObj only interface that is used by StructuredDelta to query if the given AO also provides Fast- 
35 Sync service or not. FastSync is a DLL component that is written using the third party APIs and loaded into the third 
party application to receive the changes in database while users are operating the application. It is used to speed up 
the synchronization performance by syncing only the objects that are known to IFastSync component. 



40 interface IFastSync : IUnknown 

{ 

STDMETHOD (GetFastSync) ( enumDat aClass eDataClass, BOOL* 
pbFastSync ) PURE; 
}; 



SynchNotify 



[0123] This is a CAppObj only interface that is called by Manager to notify the third party application the state of 
50 synchronization: start, finished, or reset so that the application can prepare itself accordingly. 



interface ISynchNotify : IUnknown 



55 
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STDMETHOD (SynchNotif y) ( enumSynchNotif y eNotify ) PURE; 

}; 



Server AO 

[01 24] Server Application Objects share many characteristics with desktop application objects, including support for 
10 reading and mapping to the universal record structure set forth above. 

[0125] Nevertheless, among various devices incorporated into the system of the present invention, each application 
object database will be quite different. For example, the Palm® database on the device is really just a memory space 
with records laid out sequentially in memory. In a web portal-type application, the application object may be an Oracle 
database. Server application objects may generally have less difficult tasks since the applications supported are gen- 
's erally either devices providing their own change data output, (such as Palm®-type PDA's), or which do not have a 
great deal of data to export (such as cell phones, having only name and number information). 
[0126] Nevertheless, each application object must support all calls defined in a class interface definition as follows: 



FUNCTION 


DESCRIPTION 


Open 


Perform an initialization of the device before data retrieval functions are called. 


Close 


Done with database calls, cleanup if necessary. 


Get First Modified Record 


Get the first modified record from the device and insert into application object. 


Get Next Modified Record 


Get the next modified record from the device and insert into the application object. 


Add Record 


Add a record into the application object database. 


Update Record 


Update a record. 


Delete Record 


Delete a record in the application object database. 


Set Device Records 


A function called during the synchronization manager to send a bytestream to the 
application object for interpretation. The bytestream will contain a list of records to add 
to the application object modified records list. At a later point in time, such records will 
be retrieved by the Get First Modified Record/Get Next Modified Record functions. 


Get Device Records 


For records bound to the device, this call gets a bytestream that contains a list of 
records to add back to the device. There is an outbound record list that is saved until 
this call is finished, at which time the sync server will be finished with the application 
object 


Set Device Response 


A function used to modify or repair a record input saved in the application object store 
that was sent to the device in the Get Device Records call, such as a record ID for a 
record. If 10 records were sent to the device during the Get Device Records call, one 
would expect to see 10 records coming back in during this function call. 



[0127] As noted above, because each application object database is different, the calling convention and the appli- 
cation object itself will likewise be different. The calling convention for a Palm® device's sync manager application 
object is given in the following pseudo-code: 
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Call AO: :Open 

Call AO: : WriteRecords 

Start synchronization process 

While more records in AO Data Object 

Call AO: : GetFirstModi f iedRecord { } 
Call AO : : GetNextModif iedRecord ( } 

END 

IF new records THEN 

Call AO: :AddRecord{) 
IF deleted records THEN 

Call AO: : DeleteRecord ( } 
IF update record THEN 

CALL AO: : UpdateRecord ( ) 



Call AO: :Close 



As shown therein, the calling convention is designed to be integrated with the Palm's® own sync manager. 
[0128] A second example provided below shows mapping of a portion of a web portal's contact database: 
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Mappingltem CContactTable : :m_FieldMap [] - 
i 



5 



10 



15 



u, 


eFieldTag__Contact_ 


_FirstName, 


"f irstname" } , 


(1, 


eFieldTag_Contactf 


JfliddleName, 


"middlename " } , 


{1, 


eFieldTag Contact" 


LastName, 


" las tname" } , 


{1/ 


eFieldTag Contact 


_Title, 


"title"} , 


{1, 


eFieldTag_Contact 


Suffix, 


"suffix" } , 


{1, 


eFieldTag_Contact_ 


_Anniversary , 


"anniversary" } , 


11, 


eFieldTag__Cor.tact_ 


Birthday, 


"birthday" } , 


{1, 


eFieldTag_Contact~ 


_AssistantName, 


"assistantname" } , 


{1, 


eFieldTag_Contact" 


"Children, 


"children" } , 


{1, 


eFieldTag_Ccntact] 


_CompanyName, 


"companyname" } , 


{1/ 


eFieldTag_Contact" 


Department , 


"department"} , 


{1, 


eFieldTag_Contact 


_FTPSite, 


" ftpsite" } 


11, 


eFieldTag Contact" 


Gender, 


"gender" ) , 


{1, 


eFieldTag Contact 


"jobTitle, 


" jobtitle" } , 


{1, 


eFieldTag_Contact[ 


ManagerName , 


"managernarae" } , 


{1, 


eFieldTag_Contact] 


NickName, 


"nickname" } , 


(1, 


eFieldTag Contact" 


_0f f ice, 


"office" } , 


{ 1 r 


eFieldTag Contact 


Profession, 


"profession" } , 


{1, 


eFieldTag__Contact~ 


Spouse, 


"spouse" } , 


(1, 


eFieldTag Contact" 


SelectedMailingAddress, 




" select edmailingaddress " ) 





}; 

int CContactTable: :m_nNumFields = 
sizeof (m_FieldMap) /sizeof (Mappingltem) ; 

HRESULT CPortalAddrOCI : : InsertRecord { Mappingltem theMapt], int 
25 numFields, CDataAccessor *plnsertltem, CFlItemUniversal *pUnivItem, 

bool bForceCreate ) 
{ 

bool bHasData = SetRecordFields { theMap, numFields, plnsertltem, 
pUnivltem ) ; 

30 if { bHasData I I bForceCreate ) 

{ 

// Insert the record into the database and execute the command 
p!nsertItem->InsertRovj (0) ; 
pInsert!tem->Exec ( ) ; 

i 

35 

return S__OK; 

} 

[01 29] The above example of mapping the contact field files maps contact fields from a particular web contact infor- 
40 mation database to fields in the universal record format from the master list header file (pio Jypes.h) in the system of 
the present invention. This mapping is for a specific contact table and it should be understood that other information, 
such as phone numbers, e-mail addresses, and other contact information may be stored in a separate table. 
[0130] Once data is extracted from a particular application, the server application object must then convert the in- 
formation into the universal record format which can be utilized by other server device engines to take content infor- 
45 mation into their own particular application. 

Universal Record Format 

[0131] The universal record format is used by each server device engine to handle various tasks of encapsulating 
so records in a common format, comparing records, creating and holding differences between records, and other tasks 
of synchronization. 

[0132] The universal record format allows the application objects to support a wide range of extensible application 
item types such as contacts, calendar, mail, bookmarks, and the like. Flexible type name and value associations permit 
synchronization without regard to individual vendor application information formats. Each application object encapsu- 
55 lates mapped knowledge from the vendor unique format to the universal format of the present invention. As such, an 
application object can be designed to support any combination of application and binary information types. In essence, 
application objects can be designed to support a vendor application using only binary file synchronization if the internal 
format of the application is not known. 
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[0133] Server application objects can also be designed to create collections. For example, if the user wishes to create 
a "my pictures" collection which consists of some collection of information and synchronize this collection of information, 
such an arbitrary grouping of classes of information into appropriate representations is supported. 
[0134] Because the connector layer of the interfaces to the actual storage with a vendor application varies with 
application type, application access methods can include, but are not limited to, disk or database access, network 
protocols, wireless device protocols, and the like. 

[0135] The Universal Records Format and the Universal Field Format class definitions are given below: 



typedef map < enumFieldTag, CUniversalField, less_enumFieldTag > 
UniversalRecordMap; 

typedef UniversalRecordMap : : value_type UniversalRecordPair ; 
typedef UniversalRecordMap :: iterator UniversalRecordlterator ; 
typedef UniversalRecordMap: : const_iterator 
Cons tUni versa IRecord Iterators- 
class CUniversalRecord 
{ 

private : 

UniversalRecordMap recordMap_; 

public : 

bool conflicts {const CUniversalRecords rhs); 
bool add(const CUniversalRecord &rhs); 
bool subtract (const CUniversalRecord^ rhs); 

CUniversalRecord ( ) ; 

CUniversalRecord ( const CUniversalRecordfi rhs ); 
virtual -CUniversalRecord £ ) ; 

// add this element 

HRESULT insert! enumFieldTag eld, long value, 
enumFieldDataFlag flag - eFieldDataFlag_Norraal ) ; 

HRESULT insert ( enumFieldTag eld, LPCTSTR value, 
enumFieldDataFlag flag - eFieldDataFiag_Normal ) ; 

HRESULT insert ( enumFieldTag eld," DATE value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

HRESULT insert ( enumFieldTag eld, string value, 
enumFieldDataFlag flag = eFieldDatarlag_Normal ) ; 

HRESULT insert ( Uni versalRecordPair p ) ; 

CUniversalRecord exclusiveLef twins ( CUniversalRecord& rhs ); 
CUniversalRecord inclusiveLef twins ( CUniversalRecord^ rhs ); 
bool removeSame (const CUniversalRecord Srhs) ; 

bool Findi const enumFieldTag eld, CUniversalField Afield ); 
UniversalRecordMap :: iterator find( const enumFieldTag eld ) { 
return recordMap_. find (eld) ; } 

UniversalRecordMap: : iterator begins) { return 

recordMap_ .begin {) ; } 

UniversalRecordMap: : iterator end ( ) ( return 

recorcMap_ . end ( ) ; } 

bool empty () { return 

re cor cMap__. empty () ; } 

long sized { return 

recordMap_. size ( } ; } 

UniversalRecordMap: : iterator erase (UniversalRecordMap: : iterators 

it) 

( return recordMap_. erase (it ) ; } 
void clear 0 { recordMap_. clear () ; } 

); 
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The UniversaiField Structure 



[0136] 



10 



class CUniversalField 
{ 

public : 

enum eUniversalField 
{ 

eUF_Un known, 
eUF_Long, 
eUF_String, 
eUF_Date, 
eUF Blob 



15 



20 



25 



30 



35 



40 



45 



50 



55 



protected : 

eUniversalField 
enumFieldTag 
enumFi eld Data Flag 
size t 



union 
{ 



long 1; 
DATE d; 
TCHAR* 



typeld_; 
fieldld 
flag_; 
len ; 



pCh; 



value 



public : 



CUniversalField () ; 

CUniversalField ( const CUniversalFieldfi rhs ); 

CUniversalField ( enumFieldTag itemld, long value, 
enumFieldDataFlag flag = e?ieldDataFlag_Normal) ; 

CUniversalField { enumFieldTag itemld, DATE value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

CUniversalField; enumFieldTag itemld, LPCTSTR value, 

enumFieldDataFlag flag - eFieldDataFlag_Normal ) ; 

CUniversalField! enumFieldTag itemld, string blob, 
enumFieldDataFlag flag = eFieldDataFlag_Normal) ; 

-CUniversalField ( ) ; 

bool operator=={ const CUniversalField^ rhs ) const; 

bool operator !=( const CUniversalFieids rhs ) const { return 

!operator== (rhs) ; ) 
CUniversalField^ operator- ( const CUniversalField^ rhs); 

eUniversalField getTypeO const { return typeld_; ) 

enumFieldTag getFieldlDO const { return fieldld_; } 
enumFieldDataFlag getFiagO const ( return flag_ 

size_t cetLengtht) const 

LPCTSTR getStringO const 
typeld_) ; return value_.pCh; } 
long getLongt) const 
typeld_) ; return value_.l; } 
DATE getDateO const 
typeld_j ; return value_.d; } 
string getBlobO const 
typeld_) ; return string (vaiue_ 

void get ( LPCTSTR& p ) const 

typeld_) ; p = value_.pCh; } 

void get ( lcng& 1) const 

typeld_) ; 1 = value_.l; } 

void get { DATES d) const 



[return len 



{ ASSERT ( 


eUF_ 


String — 


i ASSERT { 


eUF_ 


_Long == 


{ ASSERT ( 


eUF_ 


Date == 


{ ASSERT ( 


eUF_ 


Blob « 


pCh,lenJ; } 






{ ASSERT ( 


eUF_ 


_St ring == 


{ ASSERT ( 


eUF_ 


_Long == 


{ ASSERT ( 


eUF 


Date == 
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typeld_) ; d = value_.d; } 

void get ( strings b) const { ASSERT ( eUF_Blob =« 

typeld_) ; b . assign (value_. pCh, len_) ; } 



bool isStringO const 

eUF_String; ) 
bool isLongO const 
bool isDatet) const 
bool isBlobt) const 



{ return typeld_ == 

{ return typeld_ == eUF_Long; } 

I return typeld_ == eUF_Date; } 

I return typeld_ == eUF_Blob; } 



Example 

[01 37] An example of how data is removed from one particular application data type and converted into the universal 
record format is given below for an Oracle database: 



ffinclude "stdafx.h" 

#include <string> 
using namespace std,* 
ttinclude "FlltemUniversal . h" 

ttinclude "oci.h" 
#include "OCIDefs.h" 
#include "OCIConnect . h M 
#include "OCISession . h" 
#include "OCIColumn . h" 
^include "OCICursor . h" 
#include "DataAccessor . h*' 

^include "Univer saiMapper . h" 
#include "UniversalRecord . h" 
#include "FlUtil.h" 



#include "BaseAOSTableOCI . h" 



/* 

* Function: MapFields 

* Description: Map fields from an Oracle database record into an 
UniversalRecord format. 

*/ 

void CBaseAOSTableOCI : :MapFields ( CDataAccessor *pAccessor, Mappingltem 

theMapd, int numFields, CUniversalRecord &univRec ) 

( 

string sValue; 
DATE dtValue; 
LONG lvalue; 
double dValue; 

f or { int inx=0; inx<numFields ; inx+ + ) 
I 

enumFieldTag fieldID = theMap [inx] .m_universalFieldID; 

switch { FlPropType( fieldID ) ) 
{ 
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case eFieldType_Binary: 

{ 

// to fill properly, 1st name and last name should already be assigned 
5 CUniversalField emailField; 

string s Value ; 

if < SUCCEEDED ( BuildEmail Field ( pAccessor, 

sValue, emailField ) ) ) 

univRec . insert { fieldID, 

10 emailField. getBlobf) ); 

break; 

} 



15 



20 



25 



30 



35 



) ) 



case eFieldType_String : 

if( pAccessor->GetFieldValue ( fieldID, sValue ) 



if ( 0 == : :_tcslen {sValue .c_str () ) ) 
continue ; 

univRec . insert { fieldID, sValue . c_str ( ) 

) 

break; 

case eFieldType_DATE : 

if( pAccessor->GetFieldValue ( fieldID, dtValue 

univRec . insert ( fieldID, dtValue ); 

break; 

case eFieldType_DWCRD: 

iff pAccessor->GetFieldValue { fieldID, lvalue } 

univRec . insert ( fieldID, lvalue ); 

break; 

case eFieldType_Double : 

iff pAccessor->GetFieldValue { fieldID, dValue ) 

univRec. insert ( fieldID, dValue ); 

break; 



40 

H RESULT CBaseAOSTableOCI : ; InsertRecord ( Mappingltem theMapt], int 
numFields, CDataAccessor *plnsertltem, CF1 ItemUniversal *pUnivItem, boo! 
bForceCreate ) 
I 

bool bHasData = SetRecordFields ( theMap, numFields, plnsertltem, 
45 pUnivItem ) ; 

iff bHasData II bForceCreate ) 
{ 

pInsertItem->InsertRow (0) ; 
pInsertItem->Exec ( ) ; 

50 } 

return S_OK; 

J 

/* 

55 * Function: SetRecordFields 
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* Description: Map fields from an UniversalRecord format into an Oracle 
database record (plnsertltem) 
*/ 

5 bool CBaseACSTableOCI : : SetRecordFields ( Mappingltem theMapl], int 

numFields, CDataAccessor *plnsert Item, CFlItemUniversal *pUnivItem ) 
( 

bool bHasData = false; 
CUniversalFieid field; 

10 f or ( int inx=0; inx<numFields ; inx++ ) 

enumFieldTag fieldID = theMaplinx] .m_universalFieldID; 

BOOL bExists - pUnivItem->m_record. Find ( fieldID, field ); 

if( bExists ) 
{ 

bHasData = true; 
if( field. isBlobt) ) 
{ 

string blob = f ield . getBiob ( ) ; 
LPCTSTR szEmailAddr =* 
Get Address FromRecipients { ( F1RECI FIENTS* ) blob . c_str { ) ) ; 

if( szEmailAddr *szEmailAddr != NULL ) 
pInsertItem->SetFieldValue ( f ieldID, 

(string) szEmailAddr ); 

else 
{ 

bHasData = false; 
continue ; 

} 

} ■ 

else if ( field. isString ( ) ) 

{ 

30 string sValue = f ield - getString ( ) ; 

if( ! sVa lue . empty E ) ) 

pInsertItem->SetFieldValue { f ieldID, 

sValue ) ; 

} 

else if{ field. isLong ( ) ) 
35 { 

LONG nValue = f ield . getLong ( ) ; 
pInsertItem->SetFreldValue { fieldID, nValue) ; 

} 

else if( field. isDate {) ) 
{ 

40 DATE dValue = f ield . getDate ( ) ; 

if( dValue ) 

plnsertltem- >SetFieldValue ( fieldID, 

dValue ) ; 



15 



20 



25 



45 



50 



) if if( bExists ) 

// For all fields 



return bHasData; 

} 



[0138] While the above-identified code is specific to, for example, an Oracle database, one of average skill in the art 
will readily recognize that the technique utilized above may be adapted to other types of databases containing records 
and fields of interest. In the above code examples, alt fields which are mapped from a particular application are mapped 
55 to fields in the master mapping file. 
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Management Server 

[0139] In order to provide security and identification of particular users in an Internet-implemented synchronization 
system, a management server may be provided in the system of the present invention. The management server is a 

5 centralized server which controls behavior and characteristics of the entire network of device engines across all users. 
[01 40] Figure 1 4 shows the general representation of how a management server 1 41 0 integrates itself into the system 
of the present invention. Shown in Figure 14 is an exemplary device engine 1450 which has HTTP links to both a 
management server 1410, a storage server 1415, and a generic FTP server 1420. As will be discussed hereinafter 
with reference to the process of the present invention, and the specific implementation of the data below shown in 

10 Figures 15-17, the management server interacts with the device engine to control authorized access to information on 
the storage server, or a generic FTP server 1420,1425 to access device-specific information storage 1430 in accord- 
ance with the system of the present invention. This allows any device coupling to the Internet to have access to man- 
agement protocols and to retain user information across all platforms which the data which is being synched by the 
system of the present invention must access. 

15 [01 41 ] The management server communicates using hypertext transfer protocol (HTTP) which may be implemented 
with a secure sockets layer (SSL) to ensure security. 

[0142] In particular, the management server supports an authentication interface that requires each device engine 
to authenticate with the management server before performing synchronization. Certain storage server implementa- 
tions may utilize locking semantics to control read and write access to storage for multiple device engines. For example, 
20 in a generic FTP request, if two device engines attempt to connect to the same data at the same time, there must be 
some form of locking control to prevent device engines accessing the same data at the same time. In this instance, 
the management server controls the device engine acquisition, renewal, and releasing of locks against data stored in 
the network. 

[0143] Each device engine is uniquely identified and tracked by the management server. This allows for tailoring 
25 behavior between the management server and specific types of storage systems and device engine components. All 
device engine components are tagged and version stamped for management via the management server. 
[0144] Device actions can request updated copies of individual device engine components, permitting self-update 
and configuration of device engine systems. This permits minimal download designs for device engines that are on 
low bandwidth connections enabling the device engines to download additional required components at a later time. 
30 [0145] In a further aspect of the system, a value added component may be provided where the management server 
can support client's advertising mechanisms, enabling the display of banner or similar advertising on a device engine 
system without the need for a web browser. Cycling of advertisements, statistic collection, and the like, are managed 
via management server protocols. Online purchase and subscription mechanisms are also supported using the man- 
agement server protocol. 

35 [0146] The management server further supports the accounting, sign-up registration, device edition, storage server 
selection, and similar functions for each user in the system. In one embodiment, the management server may retain 
password and encryption information for a given user account. In a second embodiment, such information is not re- 
tained. The second embodiment provides the advantage that users may feel more secure if the maintainer of the 
management server is not in possession of the password to access data in the user's account. 

40 [0147] Further information with respect to the management server and the data flow from the management server 
to other components of the system of the present invention will become apparent with respect to the discussion of the 
process flow and data flow diagrams in Figures 15-17. 

[0148] Figure 17 shows a general depiction of the data flow and the functional specification of the management 
server utilized in accordance with the present invention. 
45 [01 49] As shown in Figure 1 7, following a welcome request 1 71 0, a user is allowed to sign out which enables an add 
user module 1712, and subsequently enables an add device module 1 71 4. If sign-up is not requested, information may 
be provided via module 1718. 

[01 50] As indicated in Figure 1 7, the add user module 1 71 2 adds user records to the user in device database 1 750. 
Additionally, the add device module 1714 adds users and devices to the user device database 1 750. A device list 1 720, 
so and a device engine download and update database 1722, provide selection data for the add device module 1714. 
The account authentication module 1 724 receives input both directly from a user log-in from the welcome screen at 
1710 and from the add device module 1714. 

[0151] Once an account is authenticated and confirmed, the administrator of the system of the present invention 
having a private data store at 1 770 may choose to provide a web desktop 1 754 which allows access to a user's records 
55 such as file 1756, e-mail 1758, calendar 1760, contacts 1762, notes 1764, and tasks 1766. The information will be 
culled from a provider database 1752 which will be synched in accordance with the system of the present invention 
as previously described. In essence, the provider database 1752 accesses data from the device engines 1780, which 
include, as discussed above, the storage server, each individual device engine 1785, and a settings database 1787. 
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[01 52] Other portions of the management server include the locking modules for beginning a sync 1 732, continuing 
a sync 1734, and ending a sync 1736, and for updating user information including modifying a user 1742, adding 
devices 1744, removing devices 1746, and modifying devices 1748. 

5 Storage Server 

[0153] Shown in Figure 14 is the storage server 1415. While storage server 1415 may include a generic storage 
model accessible through any number of standard Internet protocols, in accordance with the present invention, a flexible 
storage architecture is provided that permits various standard implementations of the system of the present invention. 

10 This allows deployment of network services without installation of new server applications and can be responsible for 
communicating change information between multiple device engines in a consistent fashion. 
[01 54] One or more storage servers 1 41 5 may be used to communicate transaction amongst a collection of devices. 
Each user's personal information network is represented by a unique account within its own data package storage 
section. The storage server 1415 maintains persistent store collection of data packages which is, at a minimum, enough 

15 data packages to be capable of synchronizing the most out-of-date system in a user's given information network or 
add information to new devices which are provided in the network. Additional data packages can be maintained to 
permit rollback of previous versions of information. The storage server can automatically dispose of older data package 
storage and can support aging of an inactive accounts. 

[01 55] Each storage server 1415 may be implemented using a variety of implementations including a standard FTP 
20 server for any operating system platform. The storage server can be implemented using HTTP protocols for increased 
efficiency and firewall avoidance. The storage server may be implemented using techniques for local storage such as 
database access or single file storage of a user's entire file system tree. The storage server 1 41 5 may utilize the stored 
foreign protocol model for moving copies of data packages to other storage servers in the system. In one embodiment, 
the storage server can allow tunneling of information using an alternative protocol to other storage servers in cases 
25 where firewall prevents originating protocol. For example, a storage server can relay an FTP traffic inside an HTTP 
protocol. Storage servers may include their own locking semantics to arbitrate multiple device engine access to the 
same server without the need for a separate management server. Each device engine can access only a specific user's 
data package storage area even though the storage server 1415 may maintain a larger number of data packages 
across a large number of users. This allows for increased scaling when the storage server is implemented using file 
30 system techniques. 

[01 56] In one aspect, the storage server is implemented using standard FTP or HTTP connections for each operation. 
HTTP is composed of request response pairs. All requests are supposed to be posting commands. Parameters can 
be set in the form known as u application/X-WWW-form-URLENCODED n . The encoding is specified as in RFC1866. 
Functions for the storage server include testing if the storage server can reach other users which will retrieve a simple 
35 text string, a "get" command which transfers the contents of a file as in a binary stream of byes; a put command as a 
binary stream of data to the storage server, a directory listing command, a remove command, a rename command, an 
exist command, and the like. 

Pull Synchronization 

40 

[0157] Figure 15 represents a "pull" synchronization process in accordance with the present invention. Both the pull 
synchronization illustrated in Figure 15 and the push synchronization illustrated in Figure 16 are done from the per- 
spective of the device engine. 

[0158] A pull synchronization as illustrated in Figure 15 is always performed prior to a push synchronization. This 
15 allows the device engine to know whether synchronization of its own data is necessary. 

[01 59] Each device has its own triggering mechanism for initiating synchronization. Some devices, such as Windows 
clients and Palm® pilots are triggered manually when the user presses a "sync" button. Other devices, such as a 
cellular telephone, may be triggered automatically after another device completes a sync. Regular, time-based triggers 
are supported as well. A web-based application portal will sync when a user logs into the website security authorization 
so mechanism, and may optionally sync on a log-out of the user or on the session time-out, but only if the user has changed 
data during the session. 

[0160] For each sync, the triggering event specifies which application types are to sync for the device. This enables 
a triggering event to trigger only a sync for a particular application type. The management server can specify that no 
sync is needed for a particular type of application to minimize traffic to the storage server. Syncs may be triggered via 
55 an HTTP request to the server. This request holds information about which device to sync and the user log-in information 
is bounced to the management server for authorization and validation. Syncs may be triggered by sending an HTTP 
request to the server and passing the authentication information in the data portion of the request to the management 
server. Each device may include a servlet that is responsible for retrieving the request and ensuring its proper format 
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before passing the synchronization request on to the server. 

[0161] The device name and device class uniquely identify a particular device type that is being synchronized, and 
is contained in the management server. Each user has one or more device entries in the management server author- 
ization records and each device name is unique for this user's space. For example, if a user has five devices with his 
or her own personal identification number, there will be five authorization records. There may be two Windows devices, 
two different Palm® devices and a web service portal, each having their own personal identification number. 
[0162] As shown in Figure 15, the pull synchronization process starts at an idle state 1 405 when the triggering event, 
described above, triggers a synchronization request. The synchronization request is confirmed at 1410 and if the re- 
quest is verified, a connection is made to the storage server at step 1415. Once a connection is established, the 
connection to the management server is made at step 1 420 to authenticate the user identification via the management 
server. If authentication is successful, the management server may initiate a management server lock on the storage 
server so that no conflicting device engines may couple to the same data at the same time. A failure at any of the steps 
1410-1425 will return the system to its idle state 1405. Once the engine server lock is acquired, the storage server will 
be checked to determine whether a new version of the data exists on the storage server at step 1 430. If no new version 
exists, the synchronization process ends. 

[0163] If a new version of the data exists, the device engine will retrieve the difference information at step 1435 "to 
get A." 

[0164] Once a A is retrieved, conflicts are resolved at step 1 450. The resolve conflicts step allows a user to resolve 
conflicts to multiple types of data which have been changed on both the server portion of the device and in the local data. 
[0165] Once the conflicts have been resolved at step 1 450, the A's are applied at step 1455. The apply A step 1 455 
allows for filters and mappings to be accounted for on the local device engine side of the system. As shown at steps 
1460, 1465, 1470, and 1475, the A may include updates at the item level 1460, application level 1465, device level 
1 470, or network level 1 475. In each of the aforementioned steps, a loop back to the A retrieval step 1 435 is provided. 
When no further A's are available, the management server lock is released at step 1440. 
[0166] The foregoing description of a pull synchronization is further described in the following pseudo-code: 
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55 



* Symbol icSyncEngine : : Sync 

Download Remote File System 

For each Symbolic app in the file system's list of symbolic apps 
CFDESymbolicSyncEngine : : SyncSymbolicApp 

Create a structured delta object -- CSt ructuredDelta 



delta (...) 



Compare local and remote versions of deltas SODs), 

if not the same then 

while localVersion != remoteVersion 

download remote version 

// apply delta (change log) 
delta . ApplyChangeLcg 
// See details below 

increment local version 

end while 

else 

25 nothing to do 

end if 

if any local items (change logs) are unsent then 

30 del ta~>Apply*Jnsent Items (Reads the changes [JCL 

where applied?] 

end if 



/ 

// Generate a new change log for the device: 
delta~>delta . GenerateChangeLog ( . . . strChangeLogFile 
. . . ) // See details below 

FTP it back up to Storage Server 

Update the local version number 

end // SymbolicSyncEngine : : SyncSymbolicApp 

end // CFDESymbolicSyncEngine: : Sync 

CStructuredDelta : : ApplyChangeLog 
45 Set up mjpAppObj ; // IFAO pointer 

Set up m_pAOS; // I AOS pointer 

Other set up (statistics, time to complete, etc.) 

Read the change log and . . . 



ApplyChangeListToAOS (f IChanges) 
for each itme in list 

ApplyltemToAOS // (Does 
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m_pAOS. . . AddRecord/UpdateRecord/DeleteRecord) 
end for 

end // ApplyChangeListToAOS 

If net doing a full sync, also add changes from this file to apply 
these to m_FlChanges 

end //CSt ructuredDel ta : : ApplyChangeLog 



CStructuredDelta : : GenerateChangeLog 

Set up m_pAppObj; // IFAO pointer 

Set up mjpAOS? // I AOS pointer 

1 $ Other set up (statistics, time to complete, etc.) 

// Set up m_deviceChanges by call to: 
CStructuredDelta : : CreateDeviceChanceList 



Create a CFlItem* pi tern 

// Iterate FAO modifications: 
for (m_pAp?Obj->GetFirstModif ied(pltem) , 
m_pAppObj->GetNextModif ied (pltem) ) 

cast pltem to — > CF1 I temUniversal* pUniltem 

//Do certain things based on whether the operation is 
an add, delete P or update. 

// Then in each case, call: 

CStructuredDelta : : GetMatchingltemFromAOS 

// First get by F1ID 
m_pAOS->GetRecordByFHD 

// See if we have an AppID, if so: 
m_pAOS->GetRecordByAppID 



// If we can build search key on it 
iterate m_pA0S->Get FirstMatchingRecord / 

m_pAOS->GetNextMatchingRecord 



end // CStructuredDelta: : GetMatchingltemFromAOS 
end for 

end // CStructuredDelta :: CreateDeviceChangeList 

45 if m_deviceChanges is not empty 

// reconcile (compare) change lists while writing to AOS 
CStructuredDelta : : ReconcileChangeLists 

For each item in m_deviceChanges . . . 

If we can find it in m_FlChanges 
50 Reconcile the device item and the fl 

item 

end if 

ApplyltemToAOS // {Does 
m_pAOS. . .AddRecord/UpdateRecord/DeleteRecord) 
end for 

55 end // CStructuredDel ta : : Reconci leChangeLists 
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it Create a new change log (Fl delta package) 
ApplyChangeListToFl {m_deviceChanges ) 
m_deviceChange . Store 

// Fires off its own whole world, see 

"1 ItemList . cpp 

end // m_deviceChange . Store 
end // ApplyChangeListToFl (n^deviceChanges ) 
report stats 

end if 

// Switch (SyncMode) 
If SyncMode == full 

App 1 y AOS T o D e v i c e 

iterate m_pAOS->Get FirstRecord . . . m_pAOS->GetNextRecord 
Add or update the corresponding FAO record, 
(Note. Never delete based on what's in AOS, apparently), 
end // ApplyAOSToDevied 

else 

ApplyChangeListToDevice (m_f IChanges) ; 
End // CStructuredDelta : : GenerateChangeLog 



25 Push Synchronization 

[01 67] Figure 1 6 shows a push synchronization in accordance with the system and method of the present invention. 
Beginning at idle state 1505, a synchronization event occurs and if confirmed at step 1510, A's are checked at step 
1515. Depending on which type of changes occurred, a network A 1520, device A 1525, location A 1530, or item A 
30 1535 will be created. 

[0168] Once the A's for a given application have been created, the method of the present invention continues at step 
1540, which enables a connection to a storage server. Upon connection to the storage server, a further connection to 
management server 1 545 will occur to authenticate the user in the system. Failure at any of the aforementioned points 
will result in returning to idle state 1505. Upon authentication, a management server lock is enabled to ensure that 
35 multiple device engines do not connect to the same data at the same time. 

[0169] Once a lock is acquired at step 1555, A's are uploaded to the system. As shown, this may include uploading 
an item A 1 575, an application A 1 570, uploading a device A 1 565, or a network A 1 560. Once A's have been uploaded 
to the server, management lock server 1580 is released, and the connection to the storage server is terminated at step 
1585. 

40 [0170] It should be recognized that such a push synchronization need not occur directly to a server, but may occur 
directly to a second device engine in accordance with the depiction of the multiple embodiments of the invention in 
Figures 1-7. 

Data Package Specification 

45 

[0171] Once information is provided into the universal data format, the device engine organizes the format into a 
data package. Each data package thus includes a description of changes to any and all information for particular 
application, and a collection of data packages describes changes across all device engines including all different types 
of data. With encoding and compression, data packages can become very compact to minimize bandwidth and storage 
50 requirements across the system of the present invention. 

[0172] In one particular aspect of the present invention, encoding of the data packages may be provided in a stream- 
ing format to allow processing by the device engines with minimal storage and memory configuration at the device 
engine level. 

[0173] The device engine can read the stream and determine which records from which applications it needs to 
55 update the particular information present on the system on which it resides. 

[0174] Data packages can be provided in a binary data format. This allows data packages to encode changes to 
non-application data at a bite level. Hence, if a single bit on a system changes, the system of the present invention 
allows synchronization of that bit on another system. Changes are described as a sequence of bite-level change op- 
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erations. One such encoding is using a sequence of insert and copy operations. Insert and copy operations generally 
define a particular "insertion" of a number of bites from a source file, then how many bites of a changed source file 
must be inserted to a particular file, then how many bites to insert from a particular new file, with a differencing engine 
taking the bites in the stream and inserting them into the new file to create the new version of the file. 

5 [0175] As will be readily understood by one of average skill in the art, this allows a user to, for example, change a 
binary file such as a word processing document or other type of attachment, and synchronize such an attachment at 
the binary level. Specifically, if one forwards an e-mail of a word document to a second individual, the second individual 
modifies it and wishes to return this document with modifications to the first individual, because the first individual has 
the original file on his system, if both systems are enabled in the system of the present invention, the second system 

w need only send the changes or the difference information back to the first system in order for the first system to recon- 
struct the document on the second system using this change data to create the document as intended by the second 
user. 

[01 76] Multiple caching of both the generation and application of data packages can be utilized to deal with commu- 
nication issues in accordance with the system of the present invention. It should be further recognized that data pack- 
15 ages can be merged into larger meta-data packages. Such meta-data information, such as the organization of multiple 
device packages, may be encoded into a larger system package. Each system package is essentially an encoded 
sequence of data packages. 

[01 77] Figure 1 2 shows the general format of the data package and universal data format an object stream hierarchy 
used in accordance with the present invention. With reference to Figures 11 and 12, one will note that each item in a 

20 particular application data structure will have a particular classification, such as a file, folder, contact, e-mail, calendar, 
etc. as shown in Figure 13. The universal data structure contains a mapped item field for each type of data possible 
from each application supported by the system. Hence a "master" list of every data field mapping possible will contain 
a large number of items. Each application object requires a subset of such fields. One exception is an application object 
used for a Web portal application which provides access to all information available on all devices, including other Web 

25 portals. 

[0178] Particular examples of item fields 1260 which may be included for any given item 1250 are shown in Figure 
13. These exemplary item objects may, for example, be from an allocation such as Microsoft Outlook. Outlook allows 
for note items 1310, e-mail items 1320, task items 1330, calendar items 1340, bookmark items 1350, file items 1360, 
channel items 1370, folder items 1380, and contact items 1390, all of which have fields such as those represented in 
30 Figure 13. 

[0179] The data format also contains folder information 1240 which allows the classification of items and conse- 
quently their associated item fields into particular categories. 

[01 80] Application objects 1 230 include information on the types of applications from which information in the stream 
is included. Device objects 1220 include information on the origin type of device which the information is originating 
35 from. Network objects 1210 include information on a user level to define that the information in the data stream is 
coming from a particular user. 

[0181] As detailed above, each application object supports a folder store interface that permits management of col- 
lections of information on a folder level, and permits management of folder hierarchies of information. The application 
object also includes an item interface that permits management of individual information entries such as records or 
40 files or components of information entries such as fields within records. Each application object further supports an 
interface for detection of a vendor application. 

[0182] A DataPack essentially contains a sequence of transactions describing changes to information. This informa- 
tion can span two basic types: structured or application data, and unstructured or binary file data. 
[01 83] Transactions are encoded using an efficient streaming format with tags to represent the actual content objects. 
45 This technique permits the continuous extension of the DataPack format as new content is supported. 

[0184] The general architecture of the package provides for transactions, application data, file data, files, objects 
and identifiers to be carried in the data package. Generally, transactions, application data, file data, and files have 
previously been described. 

[0185] The first portion of the data package will be the data package identifier. Each transaction has a basic archi- 
50 tecture of objects and operations. Each piece of content is referred to as an object and is uniquely represented with a 
Universally Unique Identifier (UUID). Objects typically are represented by a dynamically generated UUID, but more 
common objects are represented by static UUIDs. The following static UUIDs are defined: 
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UUID_GenericDe fault Folder 
UUID_DefaultContact Folder 
UUID_DefaultInboxFolder 

5 UUID_DefaultOutboxFolder 

UUID_Default Drafts Folder 
UUID_DefaultTrashFolder 
UUID_DefaultSentFolder 
UUID_Def aultCalendar Folder 
UUID^DefaultTaskFolder 

1Q UUID_ DefaultNoteFolder 

UUID_Default JournalFoIder 

UUID_DefaultFavoriteFplder 

UUID_DefaultCookieFolder 

UUID_DefaultHistoryFolcer 

UUID_DefaultChannelFolder 

UUID DefaultFileFolder 

15 UUID~DefaultCallFolder 



[0186] Each UUID has a unique 1 28 bit value which may be assigned by the system provider. 
[0187] Transactions are broken down into manageable blocks in the form of individual files. These files are then 
20 optionally compressed and encrypted and prefixed with appropriate headers. Transactions are grouped into specific 
files based on the following rules: 

• Transactions related to account information are grouped into a DataPack file. 

• Transactions related to a specific data class are grouped into a DataPack file. 

25 • Transactions referring to binary data are grouped into separate DataPack files for each file object. 

[0188] A DataPack file is identified using specific rules based on the file name. The file name is of the form "UUID. 
VER" where UUID is the identifier for the specific object and VER is the transaction version number. The version number 
is of the form "D0001 " with additional digits used for large version numbers. The "D000" value may be reserved for the 

30 base version for the object. 

[0189] The UUID for the user account is generated by the Management Server (MS). The MS also maintains a current 
table of UUID values and version numbers that provides the root structure for understanding the DataPack files within 
a user account. The MS also provides necessary locking semantics needed to maintain consistency when multiple 
device engines attempt to synchronize. 

35 [0190] All DataPacks are prefixed with a standardized header that provides basic content information regarding the 
DataPack. Compression and encryption headers follow the DataPack header if needed. 

[0191] The data package header information will include version signature, applied versioning information, content 
type, A engine type, compression type, encryption type, applied size, encrypted size, compressed size, raw data size, 
and other data useful for the device engine in decrypting the data stream to provide the data into a format usable for 
to the application. 

[01 92] The header may optimally have the format: 



Type 


Bytes 


Version 


4 


Signature 


4 


AppliedVersion 


8 


ContentType 


4 


DeltaType 


4 


CompressionType 


4 


EncryptionType 


4 


AppliedSize 


4 


EncryptedSize 


4 


CompressedSize 


4 
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Type 


Bytes 


RawSize 


4 


Reserved 


TBD 



[0193] The following ContentType values are permissible: 



Field 


Comment 


DP_CONTENT_RAW 


Raw 


DP_CONTENT_COMPRESSED 


Compressed 


DP_CONTENT_ENCRYPTED 


Encrypted 



[0194] The DeltaType encodes the type of binary file differencing used. The following DeltaType values are permis- 
sible using DataPackageDeltaType: 



Field 


Comment 


Pac kage De It aTy pe U n i n iti al ized 


Uninitialized 


Package DeltaType Raw Data 


Raw binary data 


Package DeltaType DeltaXDe Ita 


Xdelta binary difference 


PackageDeltaTypeDeltaBDiff 


Bdiff binary difference 



[01 95] The compression type specifies whether the DataPack has been compressed. A DataPack compression head- 
er follows the DataPack header if a compression type is specified. The following CompressionType values are permis- 
sible using DataPackageCompressionType: 



Field 


Comment 


PackageCompressionTypelln initialized 


Uninitialized 


PackageCompressionTypeNone 


None 


PackageCompressionTypePK 


PKZip format 


PackageCompressionTypeLZS 


LZS format 



[0196] The encryption type specifies whether the DataPack has been encrypted. A DataPack encryption header 
follows the DataPack header if an encryption type is specified. The following EncryptionType values are permissible 
using Data Pac kage EncryptionType: 



Field 


Comment 


PackageEncryptionTypeUninitialized 


Uninitialized 


PackageEncryptionTypeNone 


None 


Package EncryptionTypeXORTest 


XOR masked data 


PackageEncryptionTypeBlowFish 


Blowfish 


PackageEncryptionTypeTwoFish 


Twofish 



[0197] All DataPack compression headers are encoded using the following format: 



Field 


Size (bytes) 


Comment 


Size 


4 


Size of data including this header 
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Field 


Size (bytes) 


Comment 


Version 


4 


Version (1) 


Signature 


4 


Signature (4271) 


HeaderType 


4 


Header type (HeaderTypeCompression) 


Reserved 


12 


Reserved 


DecompressedSize 


4 


Decompressed size 


Reserved 


50 


Reserved 


Reserved 


12 


Reserved 



[0198] The following HeaderType values are permissible using DataPackageHeaderType: 



Field 


Comment 


HeaderTypeUninitialized 


Uninitialized 


HeaderType Encryption 


Encryption header 


HeaderTypeCompression 


Compression header 


HeaderType Raw 


Raw header 



[0199] All DataPack encryption headers are encoded using the following format: 



Field 


Size (bytes) 


Comment 


Size 


4 


Size of data including this header 


Version 


4 


Version (6) 


Signature 


4 


Signature (4270) 


HeaderType 


4 


Header type (HeaderTypeEncryption) 


Reserved 


12 


Reserved 


DecryptedSize 


4 


Decrypted size 


I nit Value 


16 


TBD 


KeyLength 


4 


TBD 


ClearTextKeyBits 


4 


TBD 


Salt 


4 


TBD 


PadBytes 


4 


TBD 


HMAC 


20 


TBD 


Reserved 


12 


Reserved 



[0200] The data package transaction format may take a number of forms. One example is the following: 

50 
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DataPack transaction format - header - info - objects and operations 
Diagram 

5 transaction fileData I Header + InfoList + Transact ionList 

fileData::= raw binary file data I binary difference data 

Header ID + DataPackID + DataPackVersion 

ID ::= FUSE 
•10 DataPackID : := CLOG 

InfoList ::= FieldList 



Operation 

15 Itemlnfo : 

ItemType : 
ItemFlacs 



20 



TransactionList ::= Operation + [Itemlnfo 4 [FieldList] 1 
: - see table below 

= ItemType + ItemFlags + EntrylD + ParentEntrylD 
= same as enumlteraType 
: - same as enumFl ItemFlags 

EntrylD : := UUID 
ParentEntrylD ::= UUID 

UUID : := 128-bit UUID as defined by standard 



FieldList 
FieldTag 
FieldDa ta 
F ielcDataType 
FieldDataLen 
25 FieldDataData 



:= {FieldTag + FieldData} + ListEnd 
= same as enumFieldTag 

FieldDataType + [FieldDataLen + [ FieldDataData 1 ] 
see below 

= length as required by FieldDataType 
:= data as required by FieldDataType 
ListEnd ::= DWORD(O) 



[0201] The following Operation values are permissible using the Operation class: 

30 



Field 


Comment 


cINop 


None 


clAdd 


Add 


cIDelete 


Delete 


cIChange 


Change 


cIMove 


Move 


cIRename 


Rename 


clForceChange 


Force change without conflict 



[0202] The following FieldDataType values are permissible using cIDataType: 



Field 


Comment 


cllnvalidType 


TBD 


cIString 


Unicode String bytes with a 32-bit length prefix 


clString8 


Unicode String bytes with an 8-bit length prefix 


cIString 16 


Unicode String bytes with a 16-bit length prefix 


clEmpty String 


TBD 


clBlob 


32-bit length followed by a byte stream 


cfBlob8 


8-bit length followed by a byte stream 


clBlob16 


16-bit length followed by a byte stream 
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(continued) 



Field 


Comment 


c I Empty Blob 


TBD 


clByte 


8-bit value 


cIShort 


1 6-bit value 


cIDword 


32-bit value 


clQword 


64-bit value 


cIDate 


DATE type (double) 


cIDouble 


8 byte real 


clFloat 


4 byte real 


clUuid 


1 6 byte uuid 


clZero 


Zero value 


clOne 


One value 


clUnspecified 


Unspecified value 


cIDefault 


Default value 


c I Col lection 


Collection with 32-bit length 


c I Col lection 8 


Collection with 8-bit length 


cICollection 16 


Collection with 1 6-bit length 


cl Em ptyCo I lection 


Collection with no length 



[0203] Data package objects are organized into a hierarchy as follows: 

Account::- DeviceList + DataClassList 
DeviceLis t : : = {Device} 

DataClassList : := (DataClass) + ProviderList 



ProviderList :: = {Provider} + DataStoreList 
DataStoreList; := {Folder} + ItemList 
ItemList: := {Item} + FieldList 
FieldList::- {Field} 



[0204] An account is the root structure, which identifies information about the user's account. It may have exemplary 
field tags (eFieldTag_[NAMEJ) such as Name, Password, UserName and Version. The FieldTag ItemType value is 
specified as ltemType_PIN using enumltemType. 

[0205] A device is a system identified as part of an account. Examples include PCs, handhelds, Web sites, and so 
on. It may have tags (eFieldTag JName]) such as: "name" and "type" and item type values (eDeviceJName]) such as 
Portal, Palm, Windows, CellPhone. 

[0206] A data class is a grouping of similar information types. Many data classes may be represented for a particular 
account. The data class may contain field tags (eFieldTag_[Name]) such as: Name; ItemType; SubType; IsManaged; 
Provider; Filter and Version. 

[0207] The following ItemType values are permissible using enumDataClass (eDataClass JName]): 
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5 



10 



15 



Tag 


Description 


UNKNOWN 


Unknown 


CONTACT 


Contact/address book 


EMAIL 


Electronic mail 


CALENDAR 


Calendar 


TASK 


Task/to do 


NOTE 


Note/memo 


JOURNAL 


Journal 


BROWSER 


Web browser favorites, cookies, etc. 


FILESET 


Collection of files 


PIN 


Account information 


DEVICE 


Device information 


FILEBODY 


Contents of file 



[0208] A Provider is the application that maintains specific information within a data class. There can be more than 
one provider for a particular data class. Field tags include: Name, AppObjID, Password, Username and Version. Ex- 
20 amples of provider tags permissible for the provider (eProvider[Name]) include: Portal, Palm®, MicrosoftOutlook®, 
Lotus Organizer, Microsoft Internet Explorer, Microsoft Windows, and so on. 

[0209] Data stores are the containers for storing information within a provider. There can be more than one data 
store for a particular provider. Folders represent structural organization of information within a data store. Data stores 
are not required to support folders. Tags (eFieldTagJName]) supported for each data store include: Name, ItemType, 
25 IsManaged and OriginalPath. Item types permissible for the data store include: unknown; Folder; MAPI; Database and 
Store_File. 

[0210] Folders represent structural organization of information within a data store. Data stores are not required to 
support folders. A folder is represented by a UUID and may contain any of the following field tags (eFieldTagJName]): 
Name; ItemType; IsManaged; File Attributes; CreationDate; ModificationDate; AccessDate; Special FolderType. 
30 [0211] The eFieldTagJtemType value is specified as eltemType_FOLDER using enumltemType. 

[0212] Items are individual informational components consisting of the actual user data. They may contain field tags 
such as: Name, ItemType, IsManaged, and Version. 

[0213] File items typically have the following additional field tags (eFieldTagJName]): 

35 

FileAttributes 

CreationDate 

ModificationDate 

40 

AccessDate 
FileSize 
FileBody 
DeltaSi2e 

45 

Hash 



[0214] Item types may take the format (eltemType JName]) and may include: extended; folder; attachment; contact; 

so distlist; email; calendar; task; call; note; post; journal; form; script; rule; favorites; subscription; commonjavorites; 
desktop; common_desktop; startmenu; common_startmenu; channels; cookies; programs; common_programs; star- 
tup; common_startup; sendto; recent; intern et_cache; history; mapped_drives; printers; docs; doctemplates; fonts; 
window_settings; app_dataJolder; app„settings; fileset; pin; device; data_store; file; provider; and data_class; internal. 
[0215] A field is based on one of a set of base type definitions. All field tag information is encoded using the following 

55 format: 
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Field 


Size (bits) 


Comment 


FieldTag 


16 


Unique tag number 


FieldType 


6 


Field base type 


FieldSubType 


10 


Field sub-type 



[0216] A number of Field types are possible, including: unknown; long; dword; date; string; binary; float; double; 
collection; uniqueid; qword; uuid; file; invalid. LONG is a four byte value encoded in big-endian format. FieldType 
DWORD is a four byte value encoded in big-endian format, FieldType String is a sequence of Unicode characters 
followed by a single NULL byte. Interfaces are provided with an MBCS value. FieldType Binary is a sequence of bytes. 
FieldType UniquelD is a sequence of bytes as defined by the Universally Unique Identifier (UUID) standard. AO inter- 
faces are provided with a Locally Unique Identifier (LUID) value FieldType QWORD is an eight byte value encoded in 
big-endian format. FieldType File is a UUID that references a separate DataPack containing the file body data. AO 
interfaces are provided with a sequence of Unicode characters followed by a single NULL byte that describes the full 
path name for the file. 

[021 7] Any number of filed sub types are possible. Each of the sub-types includes all of the possible data types from 
all of the supported user applications. As should be well understood, the possibilities in the number of sub-types is 
quite large, and dynamic as each new application supported by the system of the present invention is added. Examples 
of sub-types include: 



SubField Description 


Description 


Base 


No sub-type specified 


EmailAddress 


Email address 


EmailAddressList 


Email address list 


SearchKey 


Search key 


CategoryList 


Category list 


StringList 


String list 


DistributionList 


Distribution list 


Gender 


Gender (enumGender) 


TimeZone 


Time zone (enumTlmeZone) 


Boolean 


Boolean (TBD) 


NonZeroBool 


Boolean with non-zero value (enumNonZeroBool) 


Priority 


Priority 


Sensitivity 


Sensitivity (enumSensitivity) 


Importance 


Importance (enumlmportance) 


SelectedMailingAddr 


Selected mailing address (e n umSelected Mai ling Add r) 


TaskStatus 


Task status (enumTaskStatus) 


FlagStatus 


Flag status (enumFlagStatus) 


RecurrenceType 


Recurrence type (enumRecurrenceType) 


DayOfWeek 


Day of week (en urn DayOfWeek) 


DayOfMonth 


Day of month (1 through 31) 


InstanceOfMonth 


Instance of month (enumlnstanceOfMonth) 


MonthOfYear 


Month of year (enumMonthOfYear) 


BusyStatus 


Busy status (enumBusyStatus) 


AttachmentType 


Attachment type (enumAttachmentType) 


MailBodyType 


Mail body type (enumMailBodyType) 


RGB 


RGB color value 


ManagedState 


Managed state (enum ManagedState) 


Faold 


FAO ID for provider 


SpecialFolderType 


Special folder type (enumSpecialFolderType) 


ResponseState 


Response state (TBD) 


ResponseStatus 


Response status (TBD) 
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(continued) 



SubField Description 


Description 


JournalStatus 


Journal status 


PageStyle 


Page style 


PageNumberMethod 


Page number method 


DelegationState 


Delegation state 


MeetingStatus 


Meeting status 


Meeting Invitation 


Meeting invitation 


CalendarType 


Calendar type 


uateumy 


Date only 


TimeOnly 


Time only 


PhoneNumber 


Phone number 


URL 


URL 


FilePath 


File path 


PopMessagelD 


POP message ID 


MIMEType 


MIME type 


INVALID 


All values must be below this 



[021 8] The aforementioned invention provides a user-centric model of communication to deliver personal information 
via network services. This model accommodates devices that are disconnected from the network, such as the Internet, 
at various times. Personal information can continue to exist locally rather than imposing a server-centric model on 
25 existing information. 

[0219] In accordance with the foregoing, a store and forward information broadcast is utilized. Changes to existing 
information are replicated to an Internet storage server and changes are then retrieved by other devices on the network 
at device-specific times. In this manner, direct client communication is accomplished without requiring one-to-one com- 
munication. While one communication is supported by the system of the present invention, it need not be required. 

30 [0220] Although the present invention has been presented in the form of an Internet store and forward broadcast for 
the purposes of synchronizing personal information amongst various types of devices, it will be readily recognized that 
synchronization need not be accomplished as the only application for the aforementioned system. In particular, the 
system can be utilized to efficiently broadcast changes to information in so-called "push" type information applications 
where only portions of the data need to be changed on a client application. For example, in a system where information 

35 such as changes in a stock price need to be broadcast to a plurality of users, a client application implementing the 
aforementioned technology can be updated by only changing specific portions of the data in the client application 
relative to that particular stock price. This can be done using a smaller bandwidth than has previously been determined 
with other devices. 

[0221] The many objects and advantages of the present invention will be readily apparent to one of average skill in 
40 the art. All such objects and advantages are intended to be within the scope of the invention as defined by the written 
description and drawings presented herein. 



Claims 

45 

1. An system for synchronizing data between a first system and a second system, comprising: 

a first sync engine on the first system interfacing with data on the first system to provide difference information; 

so a data store coupled to network and in communication with the first and second systems; and 

a second sync engine on the second system coupled to receive the difference information from the data store 
via the network, and interfacing with data on the second system to update said data on the second system 
with said difference information. 

55 

2. The apparatus of claim 1 wherein the first system and second system are coupled to the server via a private network. 

3. The apparatus of claim 1 wherein the first system and second system are coupled to the server via an Internet 
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connection. 

4. The apparatus of claim 1 wherein the difference information is transmitted to the data store by the first sync engine 
and received from the data store from the second sync engine. 

5 

5. The apparatus of claim 4 wherein the difference information is transmitted to the data store at a first point in time, 
and received from the data store at a second, subsequent point in time. 

6. The apparatus of claim 1 wherein said second sync engine interfaces with said data on the second system to 
10 provide second difference information to the data store. 

7. The apparatus of claim 6 wherein the first sync engine couples to the data store to retrieve the second difference 
information and interfaces with the data on the first system to update said data on the first system with said second 
difference information. 

15 

8. The apparatus of claim 1 further including a management server coupled to the network and in communication 
with the first sync engine, the second sync engine and the data store. 

9. The apparatus of claim 8 wherein said management server authorizes access of difference information on the data 
20 store by the first and second sync engines. 

10. The apparatus of claim 8 wherein said management server locks access to difference information on the data store 
during communication with the first and the second sync engines. 

25 11. The apparatus of claim 1 further including a first device, coupled to the first system via the network, providing said 
data to the first system. 

12. The apparatus of claim 11 wherein the first system is a sync server. 

30 1 3. The apparatus of claim 1 1 wherein said data comprises changes to a previous state of the data, and said difference 
information comprises said changes in an encoded, universal format. 

14. The apparatus of claim 1 wherein said sync engine comprises: 
35 a data interface; 

a copy of a previous state of said data; and 
a difference transaction generator. 

40 

15. The apparatus of claim 1 wherein said data on said first system comprises application data having a plurality of 
application specific formats, and said difference information is provided for each of said formats in a universal 
format to said data store. 

45 16. The apparatus of claim 1 further including: 

a plurality of sync engines on a respective plurality of systems, each of said plurality of engines being coupled 
to receive difference information from each of said first, second and plurality of sync engines from the data store 
via the network, and each said engine interfacing with data on the system on which it resides to update said data 
on said system on which it resides with said difference information, and interface with data on said system on 

50 which it resides to provide difference data information from the system on which it resides to the data store. 

17. A system, comprising: 

a first device including at least a first data file and first differencing code having an input and an output coupled 
55 to a network to receive first device data change transactions, based on said at least one data file, from and 

provide change transactions to, said network; 

a data store coupled to the network having at least one data structure coupled to store change transactions; and 
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a second system including at least a second data file and second differencing code having an input and an 
output coupled to the network to receive said first device data change transactions, and provide second change 
transactions based on said at least second data file to said data store. 

18. The apparatus of claim 1 7 wherein the first device and second device are coupled to the data store via an Internet 
connection. 

19. The apparatus of claim 1 7 wherein the first change transactions are transmitted to the data store by the first device 
at a first point in time and received from the data store by the second device at a second, subsequent point in time. 

20. The apparatus of claim 17 wherein the first differencing code receives second change transactions from the data 
store to and interfaces with at least the first data file on to update said data with said second change transactions. 

21. The apparatus of claim 17 further including a management server coupled to the network and in communication 
with the first sync engine, the second sync engine and the data store. 

22. The apparatus of claim 17 wherein said management server authorizes access of difference information on the 
data store by the first and second differencing code. 

23. The apparatus of claim 17 wherein the first device is a sync server. 

24. The apparatus of claim 17 wherein said differencing code comprises: 

an application object; 

an application object store; and 

a delta engine. 

25. A method for synchronizing at least a first and a second resident on a first and a second systems, respectively, 
coupled to the Internet, respectively, comprising: 

determining difference data resulting from changes to the first file on the first system; 

transmitting the difference data to a server via the Internet; 

querying the server from a second system to determine whether difference data exists for files on the second 
system; 

retrieving the difference data to the second system; and 

updating the second file on the second system with the difference data. 

26. The method of claim 25 wherein said step of determining comprises: 

comparing a current instance of the first file to a stored instance of the first file; and 
generating said difference data. 

27. The method of claim 25 wherein said step of querying comprises: 

coupling to a management server which provides information on a state of said difference data for files on 
the first system and the second system. 

28. The method of claim 25 wherein said step of retrieving comprises: 

coupling to the management server; 

receiving authorization from the management server to retrieve the difference data; 
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transmitting a request to the server for the difference data; and 

receiving the difference data in response to the request. 

5 29. The method of claim 28 wherein the management server locks the server from receiving further requests for the 
difference data during said retrieving step. 

30. The method of claim 25 wherein said step of updating comprises: 

applying the difference data to a stored instance of the second file on the second system. 

10 

31. An Internet synchronization system, comprising: 

a storage server having an Internet connection; 
15 a first device coupled to the Internet and including a device sync engine; and 

a second device coupled to the Internet and including a second device sync engine. 

32. The Internet synchronization system of claim 31 further including: 
20 a management server. 

33. The Internet synchronization system of claim 32 wherein the storage server and the management server are pro- 
vided in a data center. 

25 34. The Internet synchronization system of claim 31 wherein communications between the first device, the second 
device and the storage server are encoded and compressed. 

35. The Internet synchronization system of claim 31 wherein data transfer between the first device, the second device 
and the storage server comprises difference transactions. 

30 

36. The Internet synchronization system of claim 31 wherein each device includes applications having data in an 
application specific format, and wherein communication between the first device, the second device and the storage 
server include changes to said data in an application independent format 

35 37. The Internet synchronization system of claim 31 wherein each device sync engine comprises: 

an application object; 

an application object store; and 

40 

a delta engine. 
38. A data synchronization system, comprising: 
45 a server; 

a first system having a plurality of data file types on the system; 

a differencing synchronizer on the first system extracting a first set of differencing data from the data files on 
so the first system when the data files on the system are changed, outputting the differencing data to the server, 

and retrieving differencing data from the server and applying it to selected data files on the first system; 

at least one second system having a second plurality of data file types on the second system; and 

55 a differencing synchronizer on the second system extracting the differencing data from the data files on the 

second system when the data files on the system are changed, outputting the differencing data to the server, 
and retrieving the first set of differencing data from the server and applying it to selected data files on the 
second system. 
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39. The system of claim 38 wherein said systems are coupled to allow transfer of said difference data between systems. 

40. The system of claim 39 wherein said systems are coupled via the Internet. 

5 41. The system of claim 39 further including a server coupled to each of said first and second systems to receive, 
store, and output said first set and said second set of differencing data. 

42. The data synchronization system of claim 38 wherein said first system is a server and said second system is a 
device capable of communicating with said server 

10 
15 
20 
25 
30 
35 
40 
45 
50 
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FIG. 13 
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